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PREFACE 


The present edition of The Essentials of Mental Measurement contains 
four new chapters (reprints of recent papers by each of the authors), 
to indicate in some measure, however inadequately, what changes have 
taken place in the subject, and in their opinions, since 1925 So much has 
happened since then, m that province of experimental psychology to 
which the book refers, that a completely new work would be required to 
cover the ground , and in the circumstances of the present year such a 
new book is impossible. 

A good many pages of the volume (especially chapters ix and x) are 
taken up with a critical discussion of Professor Spearman’s Theory of 
Two Factors and Thomson’s Sampling Theory The present attitude of 
each author (Brown and Thomson) to this question can be gathered from 
the new chapters, and in Thomson’s case from chapters iii and xviii of 
his book The Factorial Analysis of Human Ability (London and Boston, 
1939). Thomson has shown that the equations of the two theories can be 
transformed into one another, in either direction, by an orthogonal 
transformation. Brown has in co-operation with Stephenson assembled 
a large battery of tests of intelhgence which conforms strictly (within 
sampling hmits) to the requirements of the Theory of Two Factors That 
theory has however itself undergone important developments and ex- 
tensions in two directions For the one direction, the last sentence m 
chapter xi, written in 1924, has proved to be prophetic. 

^'Our position is”, we then wrote, ''that until the evidence is more 
clear we shall contmue to suspect that numerous and wide group factors 
are present ” The presence of such group factors, in addition to g, is now 
universally recognised, and that mainly because of the work of Professor 
Spearman and his disciples in tracing and identifying them — although 
this school regards the number of general group factors as small. 

Indeed, there is now a school of thought, led by Thurstone, which has 
entirely dethroned g and replaced its " monarchic ” rule by an " ohgarchy ” 
of group factors. In this present-day controversy we both find ourselves 
tending to prefer Spearman’s rather than Thurstone’s factors. Brown 
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does so more decidedly and confidently Thomson awaits further evidence 
but in the meantime leans to the Spearman system mainly because g is 
such a useful coefficient For him, the Samphng Theory, which is not 
incompatible with factorial descnpUon, is still however the most probable 
causal explanaUon of the interrelationships In this connection the second 
direction of development of factor theory has however to be considered. 

That is, that the recogmtion has grown more and more explicit that 
mathematically many different systems of factors can describe the facts 
of the statistical interrelationships of tests , and there is much less con- 
fidence shown in ascribing any degree of reakty to them, other than that 
attaching to mathematical coefficients. The choice between different 
systems has, it would seem, to be made on grounds of psychological 
convemence or utihty or the like, and cannot be made, at any rate solely, 
on mathematical grounds. 

WILLIAM BROWN 
GODFREY H. THOMSON 

February 1940 
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CHAPTER I 

MENTAL MEASUREMENT 

Equal appearing intervals — Just perceptible distances — The interpretation of 
Weber’s Law — Indirect methods of measurement — ^The approach to measurement 
by means of gradmg magmtudes and their differences, 

(1) EQUAL APPEARING INTERVALS 

The pre-conditions* of measurement in any sphere of experience are 
(1) the homogeneity of the phenomena, or of any particular aspect of it, 
to be measured, (2) the possibihty of fixmg a umt in terms of which the 
measurement may be made, and of which the total magnitude may be 
regarded as a mere multiple or sub-multiple. These pre-requisites are 
satisfied in the cases of spatial and temporal magnitudes, in terms of 
which, directly or mdirectly, all the measurements of the physical 
sciences are expressed. It was thought by Fechner that they are also 
satisfied m the case of the strictly psychical phenomena of sensation- 
intensity, 1 e it was assumed that any given sensation-intensity might 
be regarded as made up of a sum of unit sensation-intensities. This 
view has been definitely rejected by many later psychologists in whose 
opimon every sensation-intensity is qualitatively distinct from every 
other sensation-intensity, “To introspection, our feeling of pink is surely 
not a portion of our feeling of scarlet, nor does the hght of an electric 
arc seem to contam that of a tallow-candle m itself’ (James)t Such 
writers contend that Pechner’s mistake was due to a confusion of 

* These pre-conditions are those usually stated But the idea of measurement has 
been so expanded durmg recent generations by the mathematical ideas of continmty, 
infimty and limit that they are becommg madequate as a statement of the position. 
Compare the last section of the present chapter, on the approach to measurement by 
means of gradmg magmtudes and their differences, 
f Principles of Psychology , i. p. 646. 
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2 PSYCHOPHYSICS [pt. i 

sensation-intensities with the (physical) stimulus-values required to 
produce them. 

Nevertheless, purely psychical measurement is not entirely im- 
possible Within any one series of sensation-intensities, e g. a series of 
greys, the contrasts or distances ’’ separating different pairs of intensities 
are perfectly homogeneous with one another and can be measured in 
terms of one another or in terms of an arbitrarily chosen unit of ''sense- 
distance ’’ Given two brightness-intensities a and 6, it is quite possibk 
to find, within limits of error, a brightness-intensity c which is as much 
higher than b in the scale of intensities as b is than a, i e such that the 
sense-distance be — the sense-distance ab, or, again, it is quite possible, 
theoretically, to find a brightness-intensity d which bisects the sense- 
distance ab, 1 e which is such that it is as far removed from a in the 
scale of intensities as 6 is from it — ^in symbols, ad — db Hence the 
‘‘distance,” or disparity, of 6 from a is twice that of ^?^ni a, the distance 
of c from a is four times that of d from a If, now, ad, or th^distance 
of d from a, be taken as a conventional unit, the values of aS and oc 
will be 2 and 4 respectively*. 

— i 1 1 1 

— >■ a d b c 

Scale of 

brightness-intensities 

Fig. 1 

A scale of intensities may m this way be formed rising by "equal- 
appearing intervals” or sense-distances, and the magnitude of any given 
interval may then, theoretically, be read off in terms of the unit-distance 
employed in the construction of the scale. In practice, however, it is 
found more convenient to fix the successive scale-marks, the successive 
members of the intensity-senes, m terms of their corresponding stimulus- 
values It has been found by experiment that m the case of hght- 
intensities and sound-intensities the successive stimulus-values form, 
with fair approximation, a geometrical progression, or, in other words, 
each stimulus-value divided by the immediately preceding one gives 
approximately the same quotient. From the stimulus-values corre- 
sponding to an ascending series of eight equidistant brightness- values, 
Ebbinghaus obtained the following series of quotients: 

2-3 2d 2d hS 1-7 1-7 2^0 

♦ This view of mental measurement m terms of sense-distance first ongmated with 
J. H. L Delboenf, Eevue Phihsophtque, 1878, v. p. 53. His term for sense distance was 
“ oontraste sensible. 
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The quotient value is not entirely constant, being slightly greater 
towards the two ends of the scale than it is at or about the middle. For 
this central region, then, the general relation of the sense- distance to 
the stimulus- values is given by the logarithmic formula 

^ ^ -7- , , stimulus at h 

bense-distance ah — k log ^ , 

^ stimulus at a 

where the stimulus at a is one which gives any finite intensity of sensa- 
tion taken as the starting point or conventional zero (N B it is not 
necessarily hminal) ; the stimuli at a and b are those which correspond 
to the sensation-intensities of which ab is the '^contraste sensible’’ or 
sense-difierence. 


(2) JUST PERCEPTIBLE DISTANCES 

A mode of procedure which not only admits of much wider practical 
apphcation than the above-mentioned “method of mean gradations,” 
but also possesses a peculiar historical importance, is that which is 
concerned with the determination of the stimulus-increments corre- 
sponding to just-noticeable increments of sensation-intensity m different 
parts of the intensity scale. Weber found, m a series of experiments 
chiefly with lifted weights, that this stimulus-increment was relatively, 
not absolutely, constant for different regions of the intensity scale, i.e. 
that the stimulus corresponding to any original sensation-intensity had 
always to be increased by a constant proportion to arouse a ]ust-noticeable 
increment of the sensation-intensity. If a 103 grams weight is just 
noticeably heavier than a 100 grams weight, then the weight just 
noticeably heavier than a 200 grams weight will be a 206 grams weight, 
not 203 grams 

Mathematically formulated, Weber’s Law is: 

S (stimulus) 

T — = a constant. 

stimulus 

The quantity S (stimulus)/stimulus — or *03 in our example of weight- 
lifting — IS known as the “relative difference hmen.” It is of course the 
average value of a considerable number of determinations 

Fechner verified Weber’s Law in many different realms of sensation- 
intensity, and made it the basis of his own system of mental measure- 
ment. This he did by making the following three assumptions: 

(1) that a sensation-intensity is a measurable magnitude and may 
therefore be regarded as a sum of unit-intensities; 

(2) that just-noticeable differences of sensation-intensity are equal 

1—2 
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at different parts of the stimulus scale, and may therefore conveniently 
serve as the unit-intensities above-mentioned, 

(3) that the just-noticeable difference of sensation may be treated 
as a difference of two sensations, or at least that if Weber’s Law applies 
to the former (“sensed difference”) it will also apply to the latter 
(“difference sensation”). 

On the basis of Weber’s Law and these added assumptions, Fechner 
obtains the following formula, viz. 


i 


/ X- X ^ (stimulus) 
(sensation) == c , 

^ ' stimulus 


which he calls the fundamental fo7*mula for mental measurement. Inte- 
grating, this becomes 

sensation = c logs stimulus -f 0, 


Putting the stimulus in this equation equal to the stimulus T for which 
the sensation is just below the threshold of consciousness, i.e. = 0, we 

o = ciog,r + o. 


Subtracting the second from the first equation, 

^ , stimulus 

sensation = c log^ — = — 


Putting T == 1, and transferring to the ordmary logarithm system, we get 
sensation = h log stimulus. 

All the assumptions involved are questionable. The first one has 
already been considered at some length. It is not the single sensation- 
intensity which is measurable, but the distinctness, disparity or distance 
of one sensation-intensity from another. 

We must therefore regard the just-noticeable difference, not as a 
difference of two sensation-intensities but as a minimal sense-distance, 
if we are to be able to make use of it in our scheme of mental measure- 
ment, This modification, however, still leaves us involved in the diffi- 
culties of assumptions (2) and (3). ^ 

Fechner’s own reason for regarding all just-noticeable differences 
belonging to any one scale of intensities as equal was that they appear 
equal to introspection. Introspection in a case like this is obviously 
difficult, even for the most skilful observers, and its verdict cannot, 
therefore, be greatly relied upon. Theoretically it is quite conceivable 
that just-noticeable differences, though eqmvalent to one another as 
being all just-noticeable, i.e. as being sense-distances so small that the 
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slightest diminution of them would cause them all, equally, to cease to 
be noticeable, yet as noticed or perceived would appear of different 
magnitude one from another. Ebbmghaus points to the analogous case 
of differentials or infinitesimals in mathematics These are all equivalent 
to one another as being all equally neghgible as compared with finite 
magnitudes, yet are by no means necessarily equal to one another. If 
they belong to different ‘^orders,” those of a higher order are neghgible 
as compared \vith those of a lower, etc Again, ‘Hhe least distances 
perceived as such at different parts of the skin or m direct and indirect 
vision do not by any means all appear as equal magnitudes. On the 
contrary, so soon as they come to consciousness as distances they are 
at once perceived as distances of varying size, in a certain approximation 
to their objective differences* ” In spite of these considerations, 
Ebbmghaus regards the correspondence of the stimulus results obtained 
for equal appearmg intervals and for just perceptible intervals in the 
case of brightness-intensities (in the middle region of the scale both 
series of stimuli form a geometrical progression) as sufficient evidence 
for the approximate equahty of the latter intervals. Muller and Wundt 
had previously advanced the same argument. 

Several experimental investigations have been made with the express 
purpose of testing the relation of the methods of minimal change and 
mean gradations. Titchenerf sums up the theoretical basis of such 
experiments concisely as follows: “There are in reality two possible 
ways of workmg (1) We might take a senes of stimulus-values, corre- 
sponding to a series, say, of eight successive just-noticeable differences of 
sensation, and thereafter directly compare the two half-distances, of four 
just-noticeable differences each, and decide upon their equahty or in- 
equahty. This would be a direct method of experiment.” “Or (2) we might 
determine a few just-noticeable differences of sensation at different parts 
of the stimulus scale, in order to establish the constancy of the relative 
difference limen, and thereafter work with suprahmmal differences, and 
decide whether the same constancy holds This would be an indirect 
method, it is the method indicated by the authors just cited [Muller, 
Wundt, Kohler and Tannery]..., Either of these two methods would, 
presumably, take us to our goal. The experimental work would be 
exceedmgly difficult. Limmal determinations are always and intrinsi- 
cally difficult, and, further, the judgments passed upon just-noticeable 
differences and upon supraliminal differences are, even under the most 

♦ Ebbmghaus, Grundziige der Psychologies 2nd ed., 1905, p 624. 

f “Experimental Psychology,’* n. Instructor's Manual, p. Ixxvm 
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favourable conditions, the expressions of radically different naental 
attitudes ’’ 

It should be mentioned here that the principal rival to Pechner’s 
hypothesis — the ‘^difference hypothesis” — is that first formulated by 
Plateau, and generally known as the “quotient hypothesis.” Plateau 
adopted the psychophysical formula 

sensation = c (stimulus)^ 

on the basis of experiments by the method of mean gradations. This 
imphes, in the place of Pechner’s fundamental formula, the formula 
S (sensation) _ jj. § (stimulus) 
sensation stimulus ^ 

in other words, it assumes that just-noticeable differences are relatively, 
not absolutely, equal sensation-magnitudes. Although Plateau himseK 
withdrew his formula later, the “quotient hypothesis” still remains as 
the rival of Fechner’s “difference hypothesis ” 

To return to the experiments. Merkel (1888) worked with bright- 
nesses, pressures, and noises, and found that the stimulus corresponding 
to the sensation bisecting a suprahminal sense-distance was the arith- 
metical mean of the stimuli corresponding to the two terminal sensations, 
which would seem to support the quotient hypothesis, though such an 
inference is not entirely free from objection. Angell (1892) worked with 
noise-mtensities by the method of mean gradations, avoided certain 
sources of error present in Merkel’s form of procedure, and obtained 
results supporting the difference hypothesis, the stimulus of the bisecting 
sensation being the geometrical, not the arithmetical, mean of the 
terminal stimuh. 

A more thorough investigation was carried out by W. Ament*^ in 
1900. He used a series of Marbe greys for the brightnesses and employed 
the direct method, for the noise-intensities he used a Pechner sound 
pendulum and worked prmcipally by the indirect method. The result 
reached supported the quotient hypothesis. But Ament’s work has not 
escaped criticism. A repetition of his experiments on brightness- 
intensities by Probesf has failed to confirm his results. Ebbinghaus 
also has found, in careful experiments with rotating sectors, that just- 
noticeable differences in different parts of the scale of brightnesses are 
equal to one another. On the whole, therefore, the balance of evidence 
seems to be in favour of the “difference hypothesis ” 

* W. Ament, “tJeter das Verhaltms der ebenmerldichen zu den uebermerMiehen 
Unterschieden bei lacbt- nnd Scball-mtensitaten*’* Btudien, 1900, xvi. pp. 135 £P. 

t ZettscJmft fur Ps^chologie, xxxvL p. 344. 
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(3) THE INTERPRETATION OF WEBER’S LAW 

Fechner’s third assumption — see above, p. 4 — brings us to the 
question of the interpretation of Weber’s Law. 

There are three general forms of interpretation: 

(1) the psychophysical (Fechner), 

(2) the physiological (Muller, Ebbinghaus, James, etc.), 

(3) the psychological (Wundt). 

According to (1), the logarithmic transition takes place in passing 
from the physiological changes m the sensory centres of the cerebral 
cortex to the correspondmg sensation-intensities The chief objection 
to this view of Fechner’s is that Weber’s Law is not exact. This same 
consideration supports (2), or the physiological view, according to which 
the transition occurs either at the inception of the stimulus in the sense 
organ, or somewhere between the nerve endings and their central con- 
nections in the sensory areas of the cortex Experimental results 
obtained by Waller* and Steinachf are in favour of this view. Waller 
stimulated a frog’s eye with hght of different intensities, and found that 
the corresponding ^'negative variations” set up in the optic nerve varied 
in intensity as the logarithm of the stimulus- values (approx ). Steinach 
obtained similar results on stimulating the skm of a frog’s thigh with 
weights and noting the negative variation m the attached nerve If the 
negative variation may be assumed to be proportional to the intensity 
of the nerve-current passing along the nerve, these results point to the 
conclusion that the logarithmic transition occurs m the sense organ and 
its sensory nerve endings. 

EbbinghausJ has constructed a theory based upon the conception 
of varying degrees of dissociabihty of complex molecules to account for 
the law and also for the deviations from it towards the two extremes of 
the intensity scale 

The psychological view, (3), of the law, held by Wundt, regards it 
as a special case of the general psychological ^^law of relativity” 
Stimulus, physiological process, and pure sensation-intensity increase m 
simple proportion to one another. The logarithmic transition occurs in 
passing from mere sensation and sensation difference to apperceived 
sensation and apperceived sensation difference, and the intensities are 

* Waller, “Points relating to the Weber^Fechner Law,” Bmvriy 1895, xvm p 200 

t Stemach, “Elektromotonsche Erschemungen an Hautsinnesnerven bei adaquater 
Reizimg,” Pflugef s Arch 1896, Bd. 63, S 495 

J Ebbinghaus, “Ueber den Grund der Abweichungen von dem Weber’schen Gesetz 
bei Lichtempfindungen,” PJluger^s Arch* 1889, Bd, 54, S. 113 



8 


PSYCHOPHYSICS 


[PT I 

apperceived always m relation to one another In addition to the 
objection that it regards the sensation-intensities themselves, not their 
distances from one another, as measurable magnitudes, this view is also 
open to the criticism that it furnishes no explanation of the widely 
varying size of the relative difference hmen in different sense-depart- 
ments (e g DL for brightness-intensities = DL for sound-intensities 
~ about |-) ; the physiological view sees in the varying structure of the 
different sense organs the adequate explanation of this Moreover, the 
psychological view has no completely satisfactory explanation to give 
of the deviations from Weber’s Law so frequently met with. 

These objections and difficulties make the view improbable, but by 
no means prove it to be impossible. It has the great merit of emphasising 
more definitely than was heretofore the case the importance of the more 
purely psychological factors in psychophysical experiments — ^in par- 
ticular, it brings into prominence the distinction between mere disparity 
of sensation-intensities present simultaneously or in immediate succession 
in the same consciousness, and the perception of this disparity, the 
discnminat%on of the intensities one from another. In psycho-physical 
experiments the subj‘ect’s consciousness is not lirmted to the mere 
sensational level. 

In this connection the distinction, explained in Chapter III of the 
present book, on page 75, between two essentially different measures 
of a subject’s fineness of discrimination, is not without importance, for 
those two measures, as far as experimental work goes, are both beheved 
to obey Weber’s Law. The one is the difference threshold spoken of in 
the present discussion, the other is there defined and named the inter- 
quartile range of the point of subjective equality: and the two quantities 
appear to differ in the level, sensational or perceptual, at which they 
stand. The extended idea of the probahhty of a judgment there defined 
throws this into prominence. 

Another fact which would seem to have a very immediate bearing 
on the question of the interpretation of Weber’s Law is that plants in 
their response to the stimulus of gravity (Geotropism) appear to obey 
that law*. 

Although with continuous increase of stimulus-intensities the corre- 
sponding sensation-intensities rise in steps, each representing a just- 
noticeable difference, the psychophysical relation is really a strictly 

* H. Setting, Jahrbuch /, mss. Botanih^ Bd. xijc. 1905? P. Barwm, JSfm Phyiologistt 
1906; tJa^mes Small, Annals of Botany, xxxi. April 1917; James Small, Proc. Roy. Soc. B, 
xc. 1918. 



€H. l] 


MENTAL MEASUREMENT 


9 


continuous one, as becomes at once obvious if we consider a special case. 
The sensation-intensity aroused in lifting a weight of 100 grams is 
^^indistinguishable/’ as we say, from that aroused by 102 grams, the 
sensation aroused by 102 grams is indistinguishable” from that aroused 
by 104 grams; yet the sensation aroused by 100 grams is perceptibly 
different from that aroused by 104 grams Thus the sensation-intensity 
increases continuously, and the reason wby this is not immediately 
apparent is probably to be looked for m the physiological mechanism 
of the psychophysical organism. The fact is that statements like the 
above as to two sensations being distinguishable” or not lack precision 
in the absence of a definition of what is to be meant by distinguishable. 
To introspection almost all sensations are distmguishable from one 
another masmuch as we seldom will agree that two are identical. More- 
over, although a man will not (m the case of a subject of average sensi- 
tivity) give a majority of answers heavier in comparing 102 grams with 

100 grams, yet the number he does give will, if the experiment is 
sufficiently carefully performed, be greater than he will give with 

101 grams as the comparison weight (100 still being the standard). 
Although therefore he does not give, either with 101 or with 102 grams, 
a majority of answers heavier in comparmg them with a standard of 
100 grams, yet he does distmgmsh them from one another (if we take 
the result of a number of experiments), giving more heavier answers 
with the heavier weight*. 

Delboeuf held that the hmen has no psychological importance 
whatever If this is an extreme view, the importance which Fechner 
attributed to the hmen is equally extreme in the other direction. 

The absolute or stimulus hmen is similar in kind to the difference 
limen, since consciousness is never empty of sensation-intensities when 
such a hmen is being determmed. Here again, Fechner’s rigid distinction 
of the two was a fundamental error 

(4) INDIRECT METHODS OF MEASUREMENT 

The preceding account has probably sufficed to show that purely 
psychical measurement is a conceivable possibihty. Its practical appli- 
oation however has been more detailed than extensive. A more generally 
useful method m quantitative psychology is that which measures the 
external, physical or physiological, causes and effects of mental process. 
The measurements are made m terms of the physical umts of space and 

* Compare Pomoar4, Science and Sypothem, Scott, 1905, p. 22; and G. H. Tiiomson, 
Bntish Association Reports, 1913, paper under sub-section L 
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time, yet they are not merely physical measurements, since they derive 
all their significance from the correlated psychical processes. They are 
indirect psychical measurements*. Measurements of reaction-times, 
memory, fatigue, illusions, etc. are all of this nature. Their varieties 
are innumerable, and are illustrated by the accounts in any good text- 
book of experimental psychology (Sanford, Titchener, Myers). In all 
cases full introspective accounts are essential, and when correlated with 
the measurements make the latter essentially psychical measurements. 
Measurements of hmina, referred to in the previous section, are of the 
same nature. They are of some special importance as bemg measures of 
sensory acuity, etc. — aspects of the total mental abihty of psycho- 
physical organisms. They figure prominently in many researches based 
on the use of “mental tests.’^ 

A method which makes a partial return to the more purely psychical 
form of measurement in terms of “distance’’ is the method of ranks or 
grades. Suppose we are considering the relative abihties of, say, 100 boys 
in English Composition We should find it difficult to mark their essays 
individually in terms of any constant unit but might find it possible to 
arrange them in order of merit, especially if we had sufficient time at 
our disposal to employ the method of “paired comparisons.” According 
to the procedure of this latter method, the essays would be taken in 
pairs, quite at random, and the better essay of each pair would be given 
a “ preference mark.” This procedure would be repeated agam and again 
until every essay had been compared with every other essay. The order 
of merit is then given by the number of preferences attaching to each 
essay. In this order, however, we cannot assume that the “ability- 
distance” from one boy to the next is a constant quantity. The boys 
near the extreme ends of the series will be farther removed from one 
another than the boys near the middle. We could only adjust for this 
if we knew the law of frequency-distribution for this kind of ability in 
this particular species of boy, and theoretically the determination of 
this distribution depends upon a prior fixing of the psychological unit, 
the unit of “abihty-distance”; so that strictly the problem is insoluble. 
Since however under certain definite and indefinite conditions the form 
of distribution in a large number of biological and other cases of 
“physical” measurement has been found to be either Gaussian (normal) 
or diSering from normal in ways described by Pearson’s family of 
frequency curves, we might, with some probability of bemg near the 
truth, assume the normal form of distribution in the given case and so 
* See Ebbingiiaua, Qrundz^e der Peychohgie, 1005, pp. 75, 76. 
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obtain a quantitative measure for the ability of eacb particular boy*. 
A direct psychological determination and apphcation of the (conven- 
tional) unit-distance is not, perhaps, an entirely impossible problem, 
and work in this direction may be expected and if achieved would 
certainly be much more scientific and psychological than the present 
method of measuring in terms of the external quantum of work done. 

Finally, the interrelations of different mental abilities within any 
well-defined group of mdividuals situated within any definite environ- 
ment may be determined by means of the technical method of ^^correla- 
tion ’’ A correlation coefficient or other similar constant (e g correlation 
ratio) measures the tendency towards concomitant variation of two 
mental or other abihties within a group of individuals The result may 
be transferred to any single mdividual within the group as measuring the 
degree of probabihty of connection of the two abilities in the particular 
case The correlation between two abilities may be due to an actual direct 
relation of the abihties to one another, or, indirectly, to the influence of a 
common external environment upon them both. The first of these two 
cases IS perhaps the more important, but the possibility of the second 
should not be lost sight of, and it also has a special interest of its own. 
The problems of correlation will be considered more fully in a later chapter 

(5) THE APPROACH TO MEASUREMENT BY MEANS OF GRADING 
MAGNITUDES AND THEIR DIFFERENCES 

Since the pubhcation of the first edition of this book an important 
symposium bearing on the question of mental measurement has been 
held (m 1913). The exact problem submitted to the joint meeting of 
the Mmd Association, the Aristotehan Society, and the British Psycho- 
logical Society, was ''Are the Intensity-differences of Sensation Quanti- 
tative^’’ Although many of the arguments of that discussionf are 
beyond the province of this book, it is of interest to note that there was 
a general consensus of opinion that sensation-intensities, and their 
differences, are at least "magnitudes” which can be graded, even if 
they be not "quantities” which can be measured. And following out 
further a suggestion contained m a quotation from Mr Bertrand Russell 
made by Professor Dawes Hicks in his contribution to the symposium, 
it may here be pointed out that grading leads, if the differences can 
also be graded, to something almost indistingmshable from, if indeed it 

* This was done, e g. by Professor Pearson m his paper in Biomeirtla, 1907, v p. lOo, 
and the example has been followed with success by other workers 

t The papers are pubhshed in the Bnttsh Jcmrii, of Psychoh 1913, vi pp 137 — 189. 
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be not identical with, true measurement. For if we can arrange m order of 
magnitude a, 6, c, ... and also their first differences a — h,b — c,c — d, , 
and the differences of these differences m turn, and so on, we can space 
out the original quantities <z, 5, c, ... as accurately as though we used 
a unit and measured them. To take a simple example, suppose five 
quantities a, 6, c, d, e have really the measures 10, 16, 20, 31, 32. If an 
observer, ignorant of these measures, only knows the order of grading 
a, 6, c, d, e of the quantities, he has already made a considerable advance 
even although he does not know the spacing, or the distances apart. 
If however he further can grade the differences, that is, if he knows that 
the greatest difference is that between d and c, and that the others 
follow m the order b — a, c -- b, e — d^h^i has advanced further towards 
measurement, in the sense of accurate spacing, although there are still 
many spacings that will satisfy these gradings. Thus far he can almost 
always go in mental phenomena. And although it is practically difficult, 
there does not seem any theoretical difficulty about taking the next 
step, and grading the differences of the second order. In our example 
this gradmg is _ c) - (6 - a) or a, say, 

(c — — (e ~ d) or 

(b — a) — (c — b) or y: 

and the order of the third differences is 

If now we could have all these gradmgs we could space out the original 
quantities very closely indeed to their true positions. This can be best 
seen by attempting to alter some one of the values while leaving all 
these gradings unaltered Make d, for example, 29 instead of 31 and 
although the order a, 6, c, d!, e is unchanged, and also the order of the 
first differences, that of the second differences is completely altered. 

With an infinite number of quantities, and all the gradings of all 
their differences, we should, it would seem, arrive at an exact solution 
of the problem, so that grading and measurement are not perhaps so 
different m their nature as might at first be thought. 

Indeed a case could well be made out for the thesis that the 
theoretical objections sometimes brought against mental measurement 
really hold in the last resort agamst ail measurement, and prove too 
much: and that the real difference between mental measurement and 
physical measurement is simply that mental phenomena, being practi- 
cally more difficult to handle, force on our notice the epistemological 
difficulties inherent in all measurement, whereas in physical measurement 
famiharity has bred contempt. 



CHAPTER II 

THE ELEMENTARY THEORY OF PROBABILITY 


Some statistical terms — Antbmetioal short-cuts — ^Measures of scatter — The funda- 
mental theorem m prohabihty — ^The bmomial expansion — The normal curve of error 
— ^Fitting a normal curve to distribution data — The method of least squares 

(1) SOME STATISTICAL TERMS 

The theory of probability was developed chiefly from two classes of 
material, (a) games of chance such as com or dice throwing, roulette, 
etc., and (b) statistics, as they are called, that is such collections of 
quantitative information as the census, trade returns, insurance data and 
the hl^e. It is easy to see that psychological experiments frequently 
resemble both of these classes. Any experiment, the result of which 
depends upon a human decision, has much in common with the throw 
of a die In both cases it often seems mere chance what the result is, 
although we believe that in both cases this is due only to our ignorance 
of the numerous factors atwork^. And, since this is so, any scientific 
experiment on the actions and reactions of human beings must neces- 
sarily be repeated many times, until there accumulates a mass of 
quantitative information similar in many respects to a census return. 

The mass of quantitative information thus accumulated is found 
upon examination to have certain peculiarities or properties For 
example consider the following case — The experiments, carried out by 
Professor Urban m 1906 — 7, were on hfted weights. A standard weight 
of 100 grams was compared, by lifting it, with weights of 84, 88, 92, 
96, 100, 104 and 108 grams. The standard weight was always lifted 
first, and as the second unknown weight was lifted the judgment hghter, 
equal or heavier, was givenf. 

Suppose the following answers were obtained on one occasion; 

108 grams, answer heavier 


104 „ 

„ equal 

100 „ 

„ heavier 

96 „ 

„ hghter 

92 „ 

„ equal 

88 „ 

„ lighter 

84 „ 

„ hghter 


* “The uncertainty of my judgment is in many occurrences so equally balanced as 
I would wilhngly' compromise it to the decidmg of chance and of the dice.” Fiono’s 
Montaigne. 

f See “Die psychophysischen Massmethoden als Grundlagen empirischer Messungen,” 
by F. M Urban, ArchvfUr die gesamte Psyclhologie, 1909, xv. p. 26L 
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In this series the lowest answer heavier is at 100 grams. Let this experi- 
ment be repeated 400 times, and in every series let the position of the 
lowest answer heavier be recoided. In a particular case the distribution 
of these just 'perceptibly heavier points was as follows 

Grams 84 88 92 96 100 104 108 

Frequency ... 1 8 36 85 143 119 S 

These particulars are shown in graphic form in the adjoining figure 
where the points have been joined by straight hues to make a polygon, 
which shows at once the chief peculiarities of such a collection of data, 



Fig. 2. A cocked hat curve (Urban’s Subject IIT) 

namely that the points are not scattered anyhow, but occur most fre- 
quently at a central value from which the frequency falls off in both 
directions Such a figure as this is colloquially termed a cocked haU The 
point where the summit occurs, or point of greatest frequency, is called 
the mode. Here it is apparently at 100 grams, but if other weights 
between 100 and 104 grams could have been examined, it might be found 
to be elsewhere. The figure looks as though a smooth curve through the 
points would bring the mode somewhere a little higher than 100 grams. 

The middlemost of the 400 positions of the just perceptibly heavier 
point is called the median. It too is in the 100 gram group, though here 
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a.gain its exact position is uncertain. A better known central value (and 
one which can be more exactly calculated) is the mean or average value, 
found thus. 

lx 84= 84 

8x 88= 704 
36 X 92= 3312 
85 X 96= 8160 
143x100 = 14300 
119x104 = 12376 
8x108 = 864 

Divide by 400 ) 39800 

99 5 grams 


In the above cases the only possible values of the sought for points 
were, by the nature of the experiments, at certain definite values In 
another class of experiment, however, all values within the range are 
possible as in the following case Twenty-nine experiments were made 
of bisecting a hne by eye*. The lengths of the left-hand half of the line 
on these 29 occasions are given in this table, arranged in order of 
magnitude, 

63 8 mms. 

62 2 
62-1 
614 
613 
612 

61 2 upper Quartile 

61 1 
610 
60 9 
60 8 
60 6 
60 4 
60 3 

60 0 Median 


59 9 
69 9 
69 6 
69 5 
69 2 
69 2 

69 1 lower Quartile 

690 
68 8 
68 7 
68 6 
68 2 
681 
57 6 


29) 1743 7 

60 13 Mean. 

* An experiment performed for tbe purpose of illustrating this chapter Subject, 
G. H. Thomson 
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Here the median by counting is 60 mms. and the mean on calculation is 
found to be 60 13 mms. In this case the ‘'cocked haf’ is not at first 
sight evident, but if the data are grouped in some way it comes to hght. 
Por example, they can be arranged thus: 


One readmg 

from 63 to 63 9 mms 

mclusive 

Two readmgs 

»9 

62 „ 62 9 


39 

Six „ 


61 „ 61 9 

39 

39 

Six „ 


60 „ 60 9 

33 

33 

Eight „ 

„ 

59 „ 59 9 

39 

33 

Pive „ 

93 

58 „ 58 9 

39 

93 

One readmg 

39 

57 „ 57 9 

39 

99 


Here the numbers 1, 2, 6, 6, 8, 5, 1 show clearly the concentration in 
the middle, although being smaller they are not so regular as in the 
previous "cocked hat."’ Instead of concentrating these at points it 
seems more accurate to construct a diagram such as that here given 



Millimetres 

Pig. 3. A histogram formed from the hiseetion data 


where a rectangle of the proper height is constructed over the corre- 
spending base. Such a figure is called a "histogram.” 

This example is convenient for explaining two new terms, namely 
the "quartiles” and "semi-mterquartile range.” The "quartiles” are 
the readings which are one-quarter distant from each end, just as the 
"median” is half-way. In the table on page 15 there are 29 readings. 
29 4- 1 

The half-way reading is — ^ — or 15 from either end, and the quartiles 


are at the readmgs 


29-1-1 


or from each end, for which we can take 


the mean of the seventh and eighth readings at 59‘05 for the lower 
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quartile and 61*15 for the upper quartile. The semi-interquartile range 
IS half the distance between the quartiles. It is, in this case, 


6M5 - 59*05 
2 


1-05. 


Clearly the semi-interquartile range is a crude measure of the scatter 
of the readings. When it is large the readings are more scattered, and 
therefore, any one of them is less likely to be correct, than if the semi- 
interquartile range had been small. 

The mean value is sometimes called the expectation This term arises 
from games of chance For example, suppose I am pla 3 nLng against an 
opponent at a game of dice, in which my opponent has to give me as 
many shillings as there are pips in a single throw of the die, then the sum 
which I ought to give him before each throw, m order to make the game 
an even one, is three shillings and sixpence, which is my expectation of 
gain It IS not the most probable sum for my opponent to give me , indeed 
he will never give me this exact sum, since he always pays me m shillings 
and not in pence But at the end of a sufficiently large number of throws 
I shall have received approximately this sum per throw on the average 

From another point of view the mean will be found to correspond 
to a centre of gravity, 
namely the centroid of the 
curve of distribution of the ^ 
readmgs. Let the ad]ommg f 
figure represent such a curve, 
the number of readings 
which occur within a portion 
AB of the range being represented by the area included between the 
ordinates at A and B. Then the whole area of the curve will represent 
N the total number of readings. That is 

N=\ydx 



AB 


Fig. 4 


where the mtegration is over the whole curve. Each readmg is repre- 
sented by its position on the x-axis, and the sum of all the readings is 



The mean is therefore given by 



B. 


2 
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But this IS the expression for the abscissa of the centre of gravity of 
the curve, through which the ordinate above the mean therefore passes. 

(2) SOME ARITHMETICAL SHORT-CUTS 
There are several devices which considerably shorten the arithmetical 
labour of finding the mean. These can be illustrated by the example 
on page 15, near the top. 

Choosing a convenient ongin. The occurrence of large numbers in the 
calculations is minimised li an origin is chosen within the actual range 
of distribution, preferably either at one end or in the middle In the 
example we have in mind, the point 100 grams might be selected, as the 
large number 143 is thus avoided The calculations would then appear 
as follows. 


lx 

-16 

-16 

8x 

-12 

-96 

36 X 

- 8 

-288 

85 X 

- 4 

-340 



-740 

119 X 

4 

476 

8x 

8 

64 



540 



-740 



400) -200 


origin 100 

-f99 5 M ean 

Choosing a convenient unit Since in this particular case the measure- 
ments are all made at intervals of 4 grams, it is a considerable simplifica- 
tion if this IS chosen as the unit. The same calculation then appears as 
follows: 


lx -4 

-4 

8x -3 

-24 

36 X -2 

-72 

85 X -1 

-85 

-185 

119 X 1 

119 

8x 2 

16 

135 
-185 
400) - 50 


- 125 

^grains working unit 

- 5 

origin lOQ 

+99 6 Mean 
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The Summation Method of finding the Mean 

This IS only apphcable in cases like the present where the readings 
are concentrated at a nnmber of equidistant points. The calculation then 
appears as follows 


84 grama 

1 

400 

88 „ 

S 

399 

92 „ 

36 

391 

96 „ 

85 

355 

100 „ 

143 

270 

104 „ 

119 

127 

108 

8 

8 


400 

)1950 


4 875 

4 grams per umt 

19 5 

ongin 80 

99 5 Mean 

The figures in the second column are the continued sum, from below 
upwards, of the figures m the first column. They are then themselves 
added up, the total being 1950. Now it is clear from its method of 
formation that this total is composed as follows: 

7x8 + 6xll9-f5xl43 + 4x 85-f3x36 + 2x8 + lxl. 
That is to say, it corresponds to taking the origin at 80 grams, and a 
unit of 4 grams. 

It is instructive to try this calculation from the other end, as it were, 
making the continued sum from above downwards The reader should 
try other modifications of the idea underlying this summation method. 
For example, how should it be carried out in order to place the origin 
at 84 grams ^ 

(3) MEASURES OF SCATTER 

Let us consider again the experiment of bisecting a line, described 
on p. 15. Since the hues bisected measured 126 mms., the true half 
lay at 63 mms. The mean of the trials was 60T3 mms so that an error 
of 2*87 mms. was made. This error does not in itself however give a 
complete description of the subject’s performance, a measure of scatter 
is required One such is the semi-interquartiie range. When we say that 
the semi-interquartile range is 1*05 mms. we mean that hah the attempts 
at bisection lay within a range of 2*1 mms., and, since half the trials 
already made come within this range, the probability of the next trial 
also coming within it is one-half, apart from practice improvement. 

2—2 
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We must, however, next consider other and more usual ways of 
indicating scatter, although the use of the semi-interquartile range as 
a check is most valuable, since it is a quantity about which glaring errors 
are not likely to be made, 

(1) There is first the ‘'mean variation,” a measure much in use 
among psychologists but not one to be recommended. In this the 
deviation or variation of each reading from the mean is written down, 
and the mean of these found, disregarding their sign. Taking the same 
example of bisecting a hne we obtam 

Sum of deviations regardless of sign ^ ^ , 

M.v = ^ — r 7 -^ ^ == 1*14 mms. 

JNumber of cases n 


The mean variation is often, as here, about the same size as, or a httle 
larger than, the sempinterquartile range, which latter, it will be seen, 
is indeed the median variation, from the median, though this name is 
not used 

(2) The “standard deviation,” generally denoted by a, is by far 
the best measure of scatter to use, for reasons which will gradually 
become clear in the process of studying the subject. Its long title is 
the “root mean square deviation” and it is obtained by squarmg each 
deviation, adding the squares all together, dividing by the number of 
readmgs and taking the square root. 




Sum of squares of deviations 
Number of cases n 


If this process be carried out the value a = 1-38 will be found for our 
example. 

This is admittedly a longer process than finding the mean variation* 
It can be simplified by the following device, which should be used 
whenever the mean of the readings is a number involving awkward 
decimals. Instead of taking the deviations from the real mean, here 
60*13 mms., let them be taken from some convenient point, here say 
60 mms., chosen by mere inspection. Proceed now exactly as before, 
squaring and adding the deviations. But from the mean of the squared 
deviations must be deducted the square of the distance between the 
real mean and the convement point from which the deviations have 
been taken (see example opposite). 

The proof that this then gives the mean of the squares oi the real 
deviations is easily obtainable by elementary algebra. 

This shows one very important property of the mean, namely, that 
it is the point where the sum of the squares of the deviations is a. 
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minimum* for the 'provisional mean square is always greater than the 
real mean square, since the correction subtracted is essentially positive. 


Bisection data (page 15) 
Deviations from 60 mms. Squares of preceding 


38 

14 44 

22 

4 84 

2 1 

4 41 

1 4 

196 

13 

1 69 

12 

1 44 

1 2 

144 

1 1 

121 

1 0 

100 

09 

0 81 

08 

0 64 

06 

0 36 

04 

016 

03 

0 09 

00 

0 00 

01 

0 01 

01 

0 01 

04 

0 16 

0 5 

0 25 

08 

0 64 

08 

0 64 

09 

0 81 

10 

100 

1 2 

144 

13 

169 

14 

196 

18 

3 24 

1 9 

3 61 

24 

5 76 
29)65 71 


1 92 provisional mean square 
Subtract 0 13" = 0 02 

1 90 real mean square 

VI 90 = 138=(r. 

In this section we have, throughout, taken the mean as the central 
value from which the scatter was to be measured. In the great majority 
of cases this is the practical plan; but if necessary, measures of scatter 
from some other central value could be used. Indeed as has been 
pomted out, the semi-mterquartile range is the median of the deviations 
from the median. 

If the distribution of readings is represented by a smooth curve as 
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in the diagram on p 17, then it will be seen that the mean square 
deviation about the origin is given by the expression 

^ J x^ydx 

SO that we have the equation, symbolising the above calculation, 

~ J x^ydx — Mean^, 

the integrals being as before over the whole of the distribution. 

In practical work, mstead of actually giving the standard deviation, 
it IS more usual to quote a quantity called the ^"probable error, which 
may, for the present, be arbitrarily defined as equal to *67449cr, i e. it is 
an arbitrary reduction of a. To the meaning of this reduction we shall 
return presently. 

The Standard Deviation about the True Value 

In the section above we defined a quantity known as the Standard 
Deviation about the Mean. From another point of view, however, we 
sometimes require the value of the Standard Deviation about the True 
Value of the quantity which is being measured. This will always be a 
httle larger than the former quantity, unless the true value happens to 
coincide exactly with the Mean. This follows from the theorem that 
the sum of the squares of the deviations is a minimum at the Mean. 

Of course if we do not know the true value of what we are measurmg, 
we shall be unable to find this quantity exactly, but it can be shown 
that it is approximated to if we divide by ^ — 1 instead of n after 
finding the sum of the squares of the deviations 

Let O' be standard deviation about mean a, and o' standard deviation 
about true value A 

Let a^, < 22 , ^ 3 , ... be the readings. 

Let Cl, 62 ? •• true errors of those readings, and let e be 

the error of the mean a. 

Then a-«i = ^ + e-(4 + ei) = e-ej, 

a ^2 e 69 , etc 

Therefore 

== ^ S{e^e{f ^ 

n n n * 

ne=^ S (ej, 


Now 

and 
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so that we have 
02 = 


^>2,^2 2e/g fa) ^ ^ 


2S^(e,) 


= n -'2 . 




t'2- 




n'‘ w- 

_ (eA) 


The last term is approximately zero, the positive errors cancelhng the 
negative. 

We have finally 


■ 


S{ej?) 


n — I 


cr , 




'S ( deviation^) 
n — 1 


It will be seen that when n is sufiiciently large the two quantities 
become practically identical It is when n is small that the correction 
becomes of importance This is especially seen from a consideration of 
an extreme case, namely where only one measurement is made. 

Let us say that the one measurement made has the value v Then 
the mean has also the value the deviation is zero, and the standard 
deviation is therefore the square root of zero divided by unity That is, 
the standard deviation about the mean is zero The standard deviation 
about the true value is, however, by the above rule, indeterminate, 
being the square root of zero divided by zero. 

The reciprocal of the standard deviation is frequently used as a 
measure of the acouxacy of a set of observations. It is clear from the 
above that if the number of observations is small it is the standard 
deviation about the true value which must be used, that is we must 
employ n — 1 in the denommator instead of For otherwise the 
accuracy of a single measurement would be infinite. 


The Standard Deviation of the ArithmeHcal Mean 


In a section above it was shown that the mean ‘square of the devia- 
tions of a set of readings is a minimum at the arithmetical mean. About 
any other value distant e from the mean this mean square is mcreased 
by 

Now the mean square deviation about the mean is But the mean 
square deviation about the true value is na^[(n — 1). Therefore the 
expected square deviation of the mean from the true value is given by 




n — 1 


n-r 
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Tte expected square deviation (before experience) is, however, the same 
thing as the mean square deviation (after experience)*, so that the 
standard deviation of the mean about the true value is therefore 

or 

and that about the mean of the means will be 

The standard deviation of a mean is therefore obtained by dividing the 
standard deviation of the whole distribution by the square root of the 
number of readings. 

The Standard Deviation of Sum or Difference 

Let JT be a quantity whose standard deviation is and y a quantity 
whose standard deviation is required the standard deviation of the 
sum x-ry* Let be the mean value of x and my the mean value of y. 
Then any single value of the sum a; + will be of the form 

+ myi- hy. 

Moreover the mean of the sum x-^-y equal to m^ + my, so that the 
deviation of the above reading is 

S® + Sy. 

The mean square deviation of the sum x-{-yi^ therefore 

S (S^ + hyfjn = S {S/)jn + S {SJy)ln + S (S/)/l^. 

The quantity S {S^ Sy) however will be very small if not zero, because 
the factors and Sy are not connected with one another in any way, 
and their products are as likely to be positive as negative, so that the 
positive values will annul the negative on the average. We have, 
therefore, idnally; 

na%^==S{SJ^) + S{Sf) 

= + ncr/, 

= V{<^x^ + 

Exactly the same reasoning holds for the value of cr^_y) the only 
change being in the sign of my and hy, and therefore of S (Sa-Sj,), which 
is however zero. The final result is the same 

0 * 3 ,^ = + cr/)- 

It is assumed m both these formulae that x and y are independent and 
umorrelated. 

* Contrast Keynes, A Treatise on Pr6bdb%hty, London, 1921, pp 93 ff., on Venn’s Logic 
of Chance. 
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(4) THE FUNDAMENTAL THEOREM IN PROBABILITY 

In ordinary usage, when we say that an event is probable under 
certain circumstances, we mean that it is more likely to happen than 
not to happen, and by improbable we mean that it is more likely not to 
happen than to happen* 

If we cross-question ourselves as to why we think an event is probable 
we often find that it is because we have more frequently found it to 
happen than to fail under similar circumstances in the past 

If we wish to apply mathematical treatment to probability we must 
decide on a quantitative measure for it» We do so by using a fraction 
(vulgar or decimal) for this purpose, in such a way that the fraction 
rises and falls with the probability, becoming unity for ^'certain to 
happen” and zero for ^'certain not to happen.” The numerator of this 
fraction is the number of equally probable ways in which the event can 
happen, while the denominator is the total number of equally probable 
ways in which the event can, under the given circumstances, either 
happen or failf. 

Thus, for example, consider the probability that with one throw of 
a six-faced die a score of more than four will be obtamed. This can 
happen in two ways, namely, by throwing a five or a six. The total 
number of possible throws is six, and therefore the probability is f or 

This method of giving a quantitative value to a probability is clearly 
connected with the method adopted in bettingj For instance, odds of 
‘‘3 to 1 against” a certam event means that the speaker judges that 
there is only one chance of success to three chances of failure. The 
fraction representing the probability of success is therefore 

1 

3-f l'^4- 

If the experiment with dice mentioned above be actually performed 
a large number of times, it will be found that the number of occasions 
on which the score exceeds 4 will closely approximate to one-third of 
the whole If therefore we had never seen dice and had no idea of their 
appearance, but were told that a large number of throws always included 
about one-third which were over four§, we should conclude that the 
probability of obtaining a throw of more than four was about one-third 

♦ Of Keynes, op cit ch vm. 

f Of. however JeSries and Wrmch, Phil Mag 1919. 

j The odds at betting however depend also upon the existence of a market, cf Keynes, 
pp 22 and 23. 

§ The late Professor Weldon found 106602/(12 x 26306) = 0 3377. See Phil Mag. 
June 1900, article by Professor K Pearson. 
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This method of finding probabilities, by deducing them from a large 
number of actual experiments, is that followed most frequently in 
practice. 

For example if the points of an aesthesiometer are applied to a 
subject’s forearm, with the points distant 3 cms. from one another, 
the average subject will usually recognise that two points are present. 
Occasionally however he will only feel one point. What is the proba- 
bihty that he will answer two^ This can only be decided by experiments 
In an actual case, 150 trials were made at a Humber of different sittings. 
On 105 occasions the answer two was returned If the conditions have 
been the same throughout then the probabihty of an answer two 
under these conditions is =0 7. 

If the probability of an event occurring is p then the probabihty of 
it not occurring is clearly 1 — p, for which q is often written. For the 
event is certam to happen or not to happen, and therefore the two 
probabihties must add up to '^certainty” that is to unity. Thus in the 
above case the probability of an answer two not being returned is 0*3. 
Similarly the chance of throwing an ace at dice is ^ and of not throwing 
an ace is f. The chance of obtaming a head on throwing a com is 
and the chance of not obtainmg a head is | 

Next consider the probabihty of an event happening twice m suc- 
cession, if its probabihty is p for one occurrence. Take a few specific 
cases first. If two coins are thrown or one coin thrown twice, there are 
four equally hl^ely things than can happen, namely: 


head 

head 

tail 

tail 

head 

tail 

tail 

head 


The probabihty of getting two heads is therefore J which, it will be 
noticed, is equal to (|)^. 

Next consider two throws of a six-faced die. There are here no less 
than 36 things which can happen, for whatever value the first throw 
has there are six different throws of the second die which can be associated 
with it: and since the first can also have six values there are 6 x 6 or 
36 combinations possible. Only one of these combinations consists of 
two aces, so that the chance of throwing two aces is or (|)^. Generally, 
if the chance of an event is p then the chance of it occurring twice in 
succession is For suppose there are m ways in which it can happen, 
and n ways in which it can fail, then p == m/{m -j- n). Also, having 
happened once, there are m ways m which the second success can occur. 



CH. II] THE ELEMENTAEY THEORY OF PROBABILITY 27 


each of which ways might be associated with the first success, and since 
there are also m ways of this first success happening there are in all 
nfi ways of the double success happening. Similarly there are in all 
(m n)^ ways of the double event either happening or failing, and 
therefore the chance of a double success is 

nfi ^ 2 
{m -{- ^ ' 

Reasoning exactly similar to the above will enable the reader to 
convince himself of the truth of the following general theorem 

If there are a number of independent events a, 6, c, etc and their 
respective probabihties of occurrence are p^, .. etc, then the 

probability of all occurring is the product 


Pa X p6 X p, X ... 

This may be said to be the fundamental proposition in probabihty. Its 
use will be recognised best by an example. It will be instructive to take 
a real psychometric experiment, that already described in the experi- 
ment on weight-hfting on p. 13 The subject of those experiments com- 
pared each of the weights with the standard 450 times. The results of 
this were as follows* : 


Grams 

No of answers heavier 


84 

0 


88 

11 


92 

32 


96 

100 


100 

212 


104 

402 


108 

431 


From these the probability of the subject answering '‘heavier’’ at any 
weight can be calculated, always assuming that the conditions have 
throughout remained the same, by dividing the above numbers by 450 
We thus obtain the following: 


Grams 

Probabihty of 
answer heavier 


4 0 


84 

0000 


88 

0 0244 


92 

0 0711 


96 

0 2222 


100 
0 4711 


104 108 

0 8933 0 9578 


Let US now apply our theorem on the combmation of probabilities 
to solve the following problem 

Let the weights 84, 88 grams etc, he each presented once to the subject 
What IS the probability that the loivest answer heavier'^ will be at 96 grams'^ 
The probabihty that he will answer "heavier” at 96 grams is 0*2222. 
The probability that he will not answer "heavier” at 92 grams is 
1 — 0*0711 = 0*9289 Similarly the probability that he will not answer 
"heavier” at 88 grams is 0*9756, and at 84 grams is 1*0000 The proba- 


* Urban, op c%t p 287, Table XI (multiply the values by 450) Or alternatively 
consult Table V, p. 175, of The Application of Statutical Methods to the Problems of 
Pspchophymcs, by P M Urban, Philadelphia, 1908 
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bility of tlie combination happening, namely, an answer heavier’’ at 
96 and none below, is, therefore 

1-0000 X 0 9756 x 0*9289 x 0*2222 = 0*2014. 

The actual frequency with which this occurred was 0*2125. 

(5) IMPORTANCE OP THE BINOMIAL EXPANSION IN THE 
THEORY OP PROBABILITY 

By a not unnatural hypothesis, which has been widely accepted and 
has proved very fruitful, an error of measurement, such as that made 
m judging the half-way point in a line m an experiment above, may be 
looked upon as the resultant of a large number of small circumstances, 
each of which sometimes sways our measurement in the one direction, 
sometimes m the other. This hypothesis, combined with the fundamental 
theorem of probability just explained, leads to the use of the bmomial 
expansion m describing distributions of error. This can be illustrated 
by the following example — ^Let us suppose that a quantity which we 
desire to measure has really the value 13|- units, but that we are opposed 
in our efiorts to measure it by seven ‘^Djinns,” each of whom has the 
power of displacing our measurement by one half-unit. Let us further 
imagine that each of these mischievous imps, in an endeavour to prevent 
our making any steady measurement, decides that he will add or deduct 
his hah-unit according to the throw, heads or tails, of a com. Whenever 
we try to make a measurement, therefore, these invisible seven will 
assemble and throw each his com m the air. If all the coins happen to 
come heads, seven half-units are cunnmgly added to the 13J, and we 
obtain a measurement of 17. If all come tails, we get 13| minus 3|, 
or 10. If on another occasion five are heads and two are tails, five half- 
units will be added and two subtracted, giving 

13J + ^ — |- == 15. 

An actual test of this is given in the following figures and diagram. 
Seven corns were thrown on 128 occasions, and each time the proper 
number of half-umts was added (for the heads) or subtracted (for the 
tails) from 13|. The result was as follows: 

0 heads and 7 tads oocuiied 2 times giving a value 10 units 


1 » 

„ 6 „ 

„ 8 „ 

II 

2 „ 

„ 5 „ 

» I® 

>* 9f ft 12 

3 „ 

„ 4 „ 

. 38 

„ „ , 13 

4 « 


»» ^3 „ 

» » » 14 

5 „ 

„ 2 


»» »» 1 ^ 

6 „ 

„ 1 


» » „ 16 

7 „ 

» 0 „ 

M 3 „ 

» „ 17 


Total 128 

This distribution is shown in Fig. 5. 
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The general resemblance between the diagram, made by throwing 
coins, and previous diagrams which represent the result of psychological 
experiments is not surprising if we consider for a moment what the 
condition of such experiments are. The “D]inns’^ which oppose our 
efforts to obtain a true value for say the spatial threshold are in- 
numerable. Some are in the fingers of the experimenter, and make him 
press irregularly on the aesthesiometer points. Others cause noises to 
happen m the neighbourhood to distract the subject's attention. Other 
Djinns make the instrument hot one day and cold the next, others live 
in the subject’s skin, and quite a lot are engaged in stirring up vivid 
imaginations in his mind so that he feels all kinds of prickles and 



Fig 5 Number of heads in a throw of seven coins in 128 repetitions 


tinghngs which make his judgments on the position of the points as 
erratic at times as is the throw of a com 

In the figure, there is shown, in addition to the polygon based on 
experiment, a dotted theoretical polygon to which we now turn our 
attention. Since the probabihty of obtaining a head at one throw is |, 
the probabihty of obtaining seven heads in a throw of seven coins is 

( 4 )’ ih- 

The probability that a certain com will give a tail but all the others 
heads, is (J)® x (1 — |-) which also equals As there are seven coins 
in all, each of which might give the only tail, the total chance of 
obtaining six heads and one tail is The probabihty that two 
specified corns out of the seven will give tails, the other five giving heads, 
is (I)® X (1 — 1)^ = number of ways in which the two can be 
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specified is 21. The total chance of obtaining five heads and two tails is, 
therefore, 21/128, obtained thus, 

5? 2J W W “ 128* 

It will be seen that the above probabihties of obtaining seven, six or five 
heads are the first three terms in the expansion of (| + The next 
term will similarly be found to be the probabihty of obtaining four 
heads, and so on. We thus obtain the following results. 


Probability of 7 heads 

99 >9 ^ 99 


99 5 „ 

. 4 „ 



1 head 
no heads 


1 m 128 
7 „ 

21 . 

35 „ 


35 

21 

7 

1 

128 


99 

99 

99 


It IS these numbers which are shown by the dotted line in the figure. 

In general, if p is the probability of an event succeeding, and q of 
it not succeeding, the respective chances of it succeeding 

fc, ^ — 1, — 2, ... 3, 2, 1 or 0 


times in h trials are given by the terms of the expansion of (p d- q)^. 

In n groups of h trials therefore the most probable numbers of 
successes m the various groups are 


^ d- d- d- ... d- 


For example let the event be throwing either an ace or a six with a 
six-faced die, let six trials be made in each group, and let a thousand 
groups be tried. Then the above expansion is 




+ 


6.6 . 6.6.4 /1W2 


+ 


1.2 

6.6 

1.2 


©d) 

m 


+ 


+ 6 


1.2.3 
1 


(Sd) 

2\5 


+ 


d)‘ 


Therefore the number of times a throw consisting of only '‘aces” or 
"sixes” will occur in 1000 trials with six dice each time is most probably 


1000 _ 1000 
3« 729 


or once, to taka the nearest integer. 


In the same way we 


get this table: 
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1000 throws of six dice each time 


AU 6 are “Aces or Sixes” on 

Only 5 ff ), ff 

» ^ » j» »> ■»’ 

ft 3 ,, ,, ,, y, ,, 

O 

ft " 5» ft t tt 

„ 1 IS an ace or six „ 

None are aces or sixes „ 


1000 


729 
1200 0 
729 ^ 
60000 
729 

160000 

729 

240000 

729 

jl92^ 

729 

64000 

729 


- or approx 


1 occasion 
16 occasions 
82 „ 

220 „ 

329 
264 

88 
1000 


(Mode) 


Here the mode is at two. 

What IS the mean'^ In calculating it we shall take the exact fractions 
in the above table, not the approximate integers The mean is then 
obtained thus: 

6x 1000 - 729 = 6000 - 729 
5x 12000 - 729 = 60000 - 729 
4x 60000-729=240000-729 
3 X 160000 - 729 =480000 - 729 
2 X 240000 - 729 =480000 -729 
1 X 192000 - 729 = 192000 - 729 
Ox 64000 -729=111 

Here, therefore, the mean coincides with the mode. 

In general we have from the binomial expansion 


_ 1468000 

Sum= — ^^=2m 

x, 2000 , 

“®“=Ibob=2 




^7:^2 


1.2 


Mean equals 






hp^ +{k^l) Jcp^-^q + (I - 2) . ^ 






1.2 


p7c-dq2 


I 


= ]cp{p + qf~^ — 7cp since p + g = 1. 

The mode can also be deduced from the expansion. The first term in 
the expansion, p, corresponds to k successes, the second term to — 1 
successes, and so on, so that the term corresponding to any number m 
of successes IS 

m\{h — my, ^ 
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This term is made from the precedmg term by multiplying the latter by 

m + 1 q 
h-- m p 

and the succeeding term is made from it by multiplying by 

m q 

h — m-\-l 'p* 

It will therefore be the largest term if 

q ^ m q 

k — m p k — m 1 * p’ 
whence qm-\- q>pk — pm, pk ~ pm + p> qm^ 

qm -h pm >kp — q, Zcp + p > + pm, 

m> kp — q, kp + p> m, 
so that kp -- q < m < kp + p. 

The greatest term, therefore, is that which corresponds to a number 
of successes between kp — q and kp 4* p. The range thus indicated is 
unity since p 4 ? == 1. In the binomial expansion therefore the mean 
and the mode agree to an integer. 

Standard Deviation of the Binomial Expansion 

For the binomial expansion the standard deviation is equal to \^{kpg). 
This can be proved as follows 

In the expansion of (p + q)^ the first term p* represents the proba- 
bihty of the specified event succeeding k times. The mean number of 
times it succeeds is kp, so that the deviation is k — kp and the first 
term m is p^ x (k— kpY. Similarly the second term kp^^"^ q of the 
binomial represents the probabihty of (Z; ~ 1) successes, and the devia- 
tion is therefore (A — 1) — kp, so that the second term in is 

gr (i — 1 — kp), 

Remembermg that k — kp = kq we get the following expansion for 
= {kqf f+ikq~ I)® q + (kq - 2 )^ ^ ^ q^ + ... 

= (p 4- q)^ — 2k^q^ (p + + \kp^^'^ q 4- 4 ^ ^ 

= k^q^ — 2k^q^ 4- kq {p*“^ 4- 2 (Z; — 1) p^'^ q-r ,,,} 

= ~ ifc2g2 ^ ^ gyc^l ^ _ 1) g (p ^ 

— k^q^ 4" A? {1 4- — 1) q} 

= -- l^ff + kq{l '{■kq — q) 

= ^(1 -?) = %» a = V(^p?). 
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(6) THE NORJVIAL CURVE OP ERROR 
We have seen that a binomial expansion gives a cocked hat figure 
very hke the actual diagrams obtained by experiment. In the imagmary 
example which we considered, seven D 3 inns added or subtracted each 
a half unit to or from the quantity 13 1 which we were trying to measure. 
We then obtained measurements extendmg from 10 to 17 units, but 
always at the exact units. 

“ In practice if we were handling a not easily measurable quantity 
we might well find our measurements range over this distance, but 
unless they were constrained to do so by some pecuharity of the method, 
they would not always occur at exact units, but at any distance. This 
case is covered if we imagine the number of Djmns (the factors of 
accidental error) to be much mcreased but the influence of each one 
made less: thus there might be 7000 Djinns each adding or subtracting 
a mere fraction of a unit, or ultimately an infinite number of them, each 
adding or subtractmg an infinitesimal amount, ]ust as an infinite number 
of the tiniest errors (we may well imagine) account for the variations 
in our experimental readmgs. 

What would the binomial expansion then become^ That is, what 
form does the expansion of (| + i)* take when h becomes infinite and 
the terms are not unit distance apart but only an infinitesimal distance 
The whole range covered by the expansion is kdx^ and the term at 
either end which occurs when aU the errors are either positive or negative, 

IS at a distance Jc ~, from the middle, so that each elementary error is 

now dxl2 just as formerly it was half a umt. 

The term which corresponds to I errors being positive and h — l 
negative is p ^ ^ i ( 1 )^ 

and the net error, the abscissa of this point, is 

x = {I -- (Ic -- 1)} dxl2 ( 2 ) 

The next point, distant dx^ is that corresponding to Z + 1 positive and 
jjj 2 “* 1 negative errors, giving an abscissa of 

dxl2. 

Its probability is 

P^dP^ {if Jcy{(l + 1) ! (J - Z - 1) !}. 

The ratio of these is 

P + dP k-'l dP ^ dP h-2l-l 
~P Z + •• p ”“1+1 • 


B. &T 


8 
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But Z = -f f , from eqn. (2) for x above, so that 
dx 2 ^ " 

dP 2 (2x + dx) 

P 2x + {k-{’2) dx' 

Now we are going to make h, the number of atomic errors, equal to 
infinity, and we can therefore neglect the 2 in ^ 4- 2 and write 

dP _ 2 {2x + dx) _ ^ 4x 2dx 

P 2x kdx ”” 2x-\-kdx 2x-\‘kdx *• •• ( )•, 
dP 

Therefore j-, which is the quantity we require before we can mtegrate 
dx 

and obtain the equation to the continuous curve to replace the binomial 
cocked hat, is given by 



P dx 2xdx + kdx^ 2x-\- kdx • • •! / 

We must now consider the quantity kdx which gives the entire 
extent of scatter, the whole range. The number of errors k is infinite, 
we have assumed, and dx is infinitesimal The range kdx may then 
either be finite or infimte If we assume it to be finite, then kdx^ will 
be infinitesimal and the above equation becomes 

1 ^P _ 4a; 2 • f; 4. 

P dx 2xdx '^2x-^ kdx 
dP 

1 f 1 I • 1 W/X ^ , f ^ 


P ^ 2x-^kdx 


when dx becomes mfinitesimal. Or ■ 


infinity, except when P = 


In this case the probability falls off infinitely quickly from the mean, 
and this is therefore a case of no scatter at all. If therefore we postulate 
an infinite number of elementary errors, we must allow a possible range 
of scatter of infinite extent, the only alternative being no scatter at all. 
But although the possible range is infinite, it will be found that at 
infinity the probabihty is infimtesimal, that is the larger errors do not 
in practice occur. 

We take therefore , , 

fcax = 00 » 

k (dx)^ = a finite quantity*, 
which we shall write = 4(7^. 

(or will turn out presently to be our previous acquaintance the stan- 
dard deviation.) We then have from eqn. (4) 

1 dP ix X 

P dx 2xdx^4:(^'^ -...*.(0), 

* Here again the alternative ought to be investigated. 
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and on integrating, 

log P ^ + constant, 

or P = (6). 

This equation gives the probabihty P of any value of the error x 
occurring, and not only of any integral value, as the binomial does. 
The value of the constant 0 will be found presently, and it will also 
be shown that cr is, as has been already asserted, the same standard 
deviation which we already know in another guise. The general shape 
of such Normal Curves is shown by the example m Fig. 6, p. 43 

Soyne 'properties of the Normal Curve 

In the curve P = P is the probability of the occurience 

of an error x. Let us consider of what order of magnitude the quantities 
P are. In the first place we remember that the curve was found as the 
hmit of the expansion (|- 4- 2 ")^ when h was made infinite. This curve 
however flattens out more and more as h is inci eased. 

For example 

+ = i + l + i 

(I + 1)^ = tV + A "h lb + A + A* 

So that clearly when Tc becomes infinite, the ordinates of the curve, as 
we have so far considered it, flatten out so that they are all infinitesimal 
In other words the probabihty P of any exact value of x occurring is 
really infinitesimal though it varies from one x to another x, C must, 
therefore, be infinitesimal. Let us try putting 

C - C'dx, 

so that if G is of the same order of smallness as dx, the new quantity O' 
wall be a constant. We have then 

p = .. . (7). 

This means, m geometrical language, that instead of using a curve whose 
ordinate P measures the probability of the occurrence of x, we had 
better use a curve where this probability is measured by the area of an 
elemental rectangle contained by two ordmates enclosing x, and distant 
dx from one another (cf. Fig 4, p. 17). Such a curve will be similar in 
shape to the former but ot finite ordinates. 

We have assumed in the above argument that 0' as there defined 

3—2 
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is a finite quantity, that is that C is of the same degree of smallness 
as dx. That this is so may be shown by proceeding next to find the 
actual value of C' in the following manner. 

It is clear that the sum of the probabihties of all errors must equal 
unity, for at any one measurement it is certain that some error or other 
must occur, if we include zero error in the mathematical sense. That is 


OO 

SP= 1. 

— OO 

Substitute for P from the equation (7) above and replace the sign of 
summation by integration. We thus obtain 





1 


( 8 ). 


Write x^l{2a^) = xdx 2o-^zdz; 

then the integral becomes 

= ... (9). 

Whence, since this equals unity, we have 

C' = 1I{g'\/2\/tt), a finite quantity (10). 

So that we can now write 


P = 


dx 

O’ V (^tt) 




( 11 ). 


The ordinate of the curve defined on p. 35 is y — Pjdx so that its 
equation is t ^ 

^ = ’ 

Such a curve is called a probability curve. The probabihty of the 
occurrence of the value x is given by y^dx and the probabihty of x falling 

ra 

between a and b is given by ydx. The total area | ydx equals 

J h j — OO 


umty. 

If N measurements were made, and the errors were distributed 
according to such a curve, then the most probable number of times a 
deviation x occurred would be A curve 


y 


N 


-a:V(2o-2) 


a'\/(27r) 

IS Similar to a probability curve, but each ordinate is N times as tallf. 


♦ The reference is to Integral B m Appendix II giving the values of a number of 
integrals of general use m the theory of probabihty 

f Cf Keynes, A Treatise on Frobabthty, Icondon, 1921, p, 101 etpasstm. Keynes does, 
not regard probability as identical with statistical frequency. 
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It IS a distribution curve and its total area is not unity but N, and the 
integral from a to 6 represents not the probabihty of x falhng between 
a and h, but the most probable number of times it would fall m this 
range out of N trials 

Since this curve is symmetrical, the mean, mode and median coincide. 

Let us find the standard deviation of such a set of measurements. 

The sum of the squares of the deviations is given by 


N 

a V (27?) 


r Ndx 
J -00 <7 \/(27t) ^ 
(write ~ 2aV, 



X 2o^z^ X 


-xy{2<r^) ^ ^2 


xdx=^ 2a^zdz) 


2a^zdz 

za^J2 


X 2C* = Ncfi. 

'S/TT 


The mean square deviation is Na^JN = 

The root mean square deviation^ or standard deviation, is therefore cr, 
so that we were justified in using this letter on p 3i when we wrote 

k (dx)^ = 4ct^. 

The quantity a can be shown to have another significance in the normal 
curve, namely it is the distance from the centre to the pomt of inflection 
or point where the curve changes from convex to concave. The proof 
of this statement is as follows. At a point of inflection of a curve, the 
value of d^yjdx^ is zero In our case 




dyjdx = — 
d^yjdx^ = — 


cr V(27 t) 
1 


1 

aKVi^rr) 


g-a:7(2<r2)^ 




If this is to equal zero then x^ must equal 

Finally, if we suppose the area enclosed between a distribution curve 
and the axis of x to be spinning round the axis of y, then the moment 
of inertia is such that we can consider the whole weight concentrated 
equally at the two points of inflection. In other words, cr is the “radius 
of gyration.’’ For the area (or weight) of each vertical elementary 
column of the curve is ydx and its distance from the axis of gyration is x. 
The moment of inertia is therefore 


-aoCri/(2'7r) 


g-a:V(2(rS) ^2^^ 


* See Integral O, Appendix II, p 202. 
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Write = 2cr%2 and the integral becomes 


's/tt 


X C* = crW. 


Therefore the can be considered as concentrated at a distance a from 

Y 

the centre, or at each point of inflection. 


The Centroid of a VerUcal Slice of a Normal Curve. 

If c be the abscissa of the centroid of a shoe bounded by ordmates at 
a and b then by definition of a centroid or centre of gravity, 

c X area of slice = — ^;= [ ^ xdx 

aV27T Ja 


Tg-xW). 
0*2 — 

L crV27r ]h 

= iVa - Vb) 


For unit area and unit a therefore the abscissa of the centroid of a slice 
is the difference of the bounding ordmates divided by the area of the 
shoe (cf p. 128). 


The Relation between Mean Variation and Standard Demotion^ 
in the case of Normal Distribution. 


The mean variation is the abscissa of the centroid of half the curve: 
and therefore by the above 

M.V. = 

i 

= 2 ( 72 f— i=-o) 

VS 

== O' == 0*8(7 approx. 


The Relation between Probable Error and Standard Deviation, 
in the case of Normal Distribution. 

The probable error was defined on p. 22 as an arbitrary reduction 
of the standard deviation, viz. 

p.E. == *674:50. 

In the case of Normal Distribution a physical meaning can be given to 

* See Integral O m Appendix IL 
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this quantity. Consider the number of cases which fall within the limits 
of the range ± 6745cr. This number is 


2 X 


N 


-j: 


67450 - 


cry (277), 

Values of the probability integral have been calculated and tabulated 
for all hmits, and if such a table be consulted* it will be found that this 
N 

quantity has the value That is to say, the probable error gives the 


range within which one-half the cases may be expected to fall It is 
more instructive to remember that half the cases may be expected to 
fall outside ± p. e 

With skew distributions this meaning ceases to hold, and for these 
a should be used. Indeed it is in general a better quantity to employ. 


(7) ON FITTING A NORMAL CURVE TO DISTRIBUTION DATA 


Consider the experiment of bisecting a line of which the data are 
given on p 15. The histogram of Fig. 3, p. 16 represents these data, 
and shows the density with which these points occur in each part 
of the range. We wish to replace this stepwise figure by a smooth 
Normal Curve which will give us at each point of the range the theoretical 
proportionate density of the bisection points at that spot, and we want 
this Normal Curve to be the most probable which can be based on the 
given data. 

The equation of the required curve is 





g-(a;-a)V(2o-2) 


where N is the number of experiments made, x is measured in mms , 
and {x — a) IS a quantity measured from some central point of the data 
In the theoretical curve (which is symmetrical) a is the point where 
mean, mode and median coincide. In the data however the mean is 
60*13 and the median 60 while the mode is unknown. What value shall 
we give to a so as to obtain the best fitting curve? 

To answer these questions it is necessary to consider what we mean 
by best fitting curve. 

The meanmg of ‘‘best fitting curve” is really the same as the 
meaning attached to the phrase “most probable theory ” By the best 
theory of any set of data we mean the theory from which the observed 
data could have chanced to sprmg with a greater probabihty than would 


* E g. the first table in Pearson’s Tables for StahsHcians and Biometr%ciana 
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be the case with any other theory. Take a simple example. Suppose 
a bag IS known to contain a large number of equal-sized balls and nothing 
else: but the colours of the balls are entirely unknown. Experiments 
have been carried out to learn something about their colours, each 
experiment taking the form of extracting one ball, noting its colour, 
and replacing it. Ten such experiments have been made and the results 
are as follows: 

5 black balls, 

3 white balls, 

1 red ball, 

1 green balL 


What is the best theory of the composition of the bag *2 

The best theory on the facts as given, is that the bag contains 
^ths black balls, j-^^ths white balls, ^th red balls, and -j^th green balls. 

Suppose however that another theory was advanced, namely that 
the bag contained j%ths black balls, j%ths white balls, and j^^th each of 
red, green, yellow and blue balls. How should these two theories be 
compared^ 

The proper plan is to find the probability, on each theory, that 
ten dips would result in what was actually observed. Then that theory 
IS best for which this probabihty is greatest. Let us take first the theory 
which we assert to be the best. The probability, on that theory, of 
drawing five black, three white, one red and one green ball (the order 
being immaterial) is 


'5^V3\3 1 1 10! 

loj Uoj ‘10’10’5!3!1!1! 


0-042525, 


The corresponding probability on the other theory is 


• 4 \ 5 / 4\3 1 1 10 ! 

,12; U2/ ‘I2’l2’5f3!l!l! 


0 005335. 


The former theory is therefore the better of the two. If from other 
sources we knew however that the bag did contain balls of six colours, 
then the first theory would be ruled out, and the second theory would 
have to be compared with other six-colour theories. The reader might, 
for example, compare it with the theory that the bag contains 
black, Y^ths white, x\^hs red and ^^th each of green, blue and yellow 
balls. 

Turn now to our actual experiments on bisecting a line. The 29 
experiments are like 29 dips into a bag, resulting in the numbers on 
p. 15 being drawn. From our general consideration . of the problem 
we believe that the numbers in the bag form a continuum, that is we 
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think that another bisection mark might fall anywhere within the range, 
and not only at points already struck, though of course our measurements 
are only being made to the nearest tenth-milhmetre. Secondly we think 
that a curve of the form 


?/ = 


N 


cr'v/(27r) 


g-a;2/(2(r2) 


Will express this continuum. The problem is, which curve of this form 
is the best fitting one. This is decided in exactly the same way as was 
the above example of the coloured balls For each curve find the 
probability that the actually observed distribution may have arisen 
from it by random sampling. Then that curve is the best for which this 
probability is greatest. 

The actual process of trial and error giving now this now that value 
to cr and a would take too long, and we find the optimum values by the 
usual process of the difierential calculus. Let us do so in a quite general 
manner, taking n values (instead of 29 as here). 

Given a distribution following the law 






ax/Clir) 


what IS the probability Q that the n special values 


Will be obtained in a set of n trials (the order being immaterial)^ The 
probability of Xk is 

and the required probabihty is equal to the continued product of a 
number of such expressions, in which A takes the values 1 to ^ succes- 
sively, multiphed by n ! because the order is immaterial. 

We therefore have 

Q = n\ e-^K-»)W). 

\a V 277/ 

This probability we wish to make a maximum by choosing the best 
values of a and a. We must therefore put 

dQjda = 0 

and dQjda = 0. 

Now ^ = n! f x 
da \aV2iT/ 
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and since this equals zero we must have 

S {Xi, - a) = 0, 

S (xk) = S (a) na, 
a ~ S {X))jn. 

That is, a must be the mean of the observations Turning now to the 
second equation we have (omitting from the first the factor 
which is independent of a) 


da (a” 
Therefore 




~n+3 


8 {xx — aY ~ nu^\ == 0. 


na^ = S {Xx — Ci)^i 


0-2 — 8 {xx aYjn^ 

i.e. a IS the standard deviation of the readings. 

We find therefore that to obtam the best fitting curve we must 
find a the value of the mean of the observations, and a the value of the 
standard deviation. In the case m question 


a = 60-13, 


cT= 1-38, 


where x is in mms. This curve is drawn on the adjoining figure. Calcula- 
tions, such as those required to find a number of ordinates of the above 
curve for the purpose of drawmg it, are best performed in tabular 
fashion. For example, the present calculation might be arranged as 
follows, and the reader should calculate one or two ordinates for practice 
by this means 


(a) 

(6) 

(C) 

(d) 

(«) 

(/) 

X m mms. 

a; ~ 60 13 

I ^1- 

Column c 
X loge 

Reciprocal of 
Antiiog column 


2 X 1 38® 

ex 1 38^(2 jt)"^ 








This arrangement is smtable for an approximate calculation using 
a ten inch shde rule, from which the logarithms are also taken. The 
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accuracy thus attained is quite as great as the extent of the expeiiment 
justifies. If logarithm tables, or calculating machines, were to be used, 
somewhat diSerent tabular arrangements would be required. 

Some of the calculation in the above table has, however, once and 
for all been done and printed in tables of the probability curve The 
best of these for our purpose is Sheppard’s table, printed as Table II 
in Professor Pearson’s Tables for StatisUcians and Biometncians. 



MiUimetres 

Fig. 6 A normal curve fitted to tlie bisection data. 
The histogram is also shown 


Fitting a Normal Curve to the Bisection Data with the 
Aid of Sheppard's Tables^ 


I 

II 

III 

IV 

V 

X in mms 

x'^x-GO 13 

Sheppard’s x 
x'jl 38 

Sheppard’s z 

y=29s/l 38 

60 13 

0 

0 

•3989432 

8 38 

60 

013 

009 

397 

8 34 

59 5 

0-63 

0 46 

359 

7 54 

59 

1 13 

0 82 

285 

5 99 

68 5 

163 

118 

199 

4 18 

68 

2 13 

154 

122 

2 56 

57 

3 13 

i 2 27 

030 

0 63 

66 

4 13 

2 99 

005 

Oil 


The other half of the curve can be drawn by symmetry No interpolation is here used m 
the tables. A shde rule, or Crelle’s Calculating Tables, can be used for the multiphcations 

* Of course an experiment of only 29 observations does not justify any curve fittmg 
at all, as the accuracy is not sufficient, the sample not being large enough But a short 
example is necessary for explanatory purposes m a text book. 
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We are at present only concerned with. Sheppard’s first and fifth 
columns headed x and z respectively. These are connected by the 
relationship 


z = 


V(27r) 




that is they give a curve with N 1 and o- = 1. The x of Sheppard’s 
table is, therefore, obtained from our x by division by cr, and his z needs 
to be multiphed by N/or. Our calculation then takes the form shown 
above Fig 6. 

It must be clearly understood that there are two parts m any curve 
fitting problem Firstly there is the decision as to what kind of curve 
is to be used, and secondly the finding of the best fitting curve of this 
kind. If it were merely a question of getting a curve to fit the particular 
data of one problem, then a curve could always be drawn to fulfil the 
conditions exactly. It is only because general considerations dictate that 
the curve shall be of a certain kind, that an exact fit cannot be obtained 
and the best fit has to be found. 


(8) THE METHOD OF LEAST SQUARES 

The principles adopted in the last section are those which underlie 
the Method of Least Squares, which is employed to find the best 
solutions of a set of Imear equations which are more numerous than 
the unknowns, and shghtly inconsistent with one another. To illustrate 
the principle take three equations for two unknowns, 

ax -{’hy -i- c =0, 
a'x + h'y + c' =0, 

4* 6'V + c" - 0. 

The quantities a, a\ a", 6, etc. having been measured, the equations 
are found not to come to zero for any values of x and y^ but to give 
"^'residuals” v\ and v" thus* 

ax + by + c = -y, 
a'x -h h'y 4- c' == v\ 
a"x + h"y + c" - 

Now the presence of these residuals v may be assumed to be due to 
numerous small errors in the coeJficients a, b, c, and the distribution of 
any -y, were one of these equation-observations to be repeated many 
times, will, it may be assumed, be a Normal Curve. The probability 
of occurrence of v will therefore contain as chief factor and the 
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probability of occurrence of v, v' and (presuming them independent) 
will contam the factor 

X X or 

where S (t;^) = 

To make this probabihty a maximum we must make 8 (v^) a minimum, 
whence the name Least Squares. The conditions for ;S (y^) a minimum 
are 

dSjdx = dS/dy = 0, 

and also (though in practice it is not necessary to find them) the second 
differentials must be negative. We get at once 

~ ^{ax + &«/ + + ^'y + + ^' 0^1 

= 2 (a2 + a'2 + a"2) a; + 2 (a6 + aV + «"&") 2/ 4- 2 (ac + a'c' + a"c") = 0, 
and similarly for y. 

The two equations thus reached are called Normal Equations. There 
will of course always be as many of them as there are unknowns If the 
original equations were not of equal rehability or weight they must of 
course first be multiphed by their weights. The rule of Least Squares 
is therefore : To obtain the Normal Equation for any unhnown x, multiply 
each equation by its weight w, and by the coefficient of x in that equation, and 
then add all the equations together. The Normal equations m our example 
are thus. 

8 {ahjo) 8 {abw) y 8 {acw) = 0, 

8 (abw) x + 8 (b^w) y + 8 (bcw) = 0, 
whence unique values of x and y can be found. 

Note, 1924 The work of Keynes on probability had not been published when this 
chapter was written, or a number of points might have been put differently For mstance 
Keynes pomts out that odds at bettmg depend not only on the chance of success but also 
on the market available. And m his oh. vin, on his pages 94 and 100, and elsewhere, are 
many fundamental questions which, though they could not be discussed, ought perhaps 
to have been mentioned here. 



CHAPTER III 

THE PSYCHOPHYSICAL METHODS 

Experimental methods and mathematical processes — The method of limits — ^The 
method of average error — ^The constant method — ^Difference thresholds and the 
probabihty of a judgment of a certain category 

(1) EXPERIMEOTAL METHODS AND MATHEMATICAL PROCESSES 

The experimental determination of absolute and difference thresholds 
or limina is complicated and difficult A considerable number of physical 
and psychological, and, it may be added, mathematical, factors is 
involved, of varying relative importance in different cases The result 
IS that different methods of procedure have been found most suitable 
for different cases. These methods have been traditionally grouped 
under three (or four) distmct headings, and called the Psychophysical 
Methods. They are 

(1) the Method of Limits (Method of Mmimal Changes), 

(2) the Method of Average Error (Method of Production), 

(3) the Constant Method (Method of Eight and Wrong Cases). 

A fourth method is generally added to the hst, viz. : 

(4) the Method of Equal Appearing Intervals, or Method of Mean 
Gradations, but this is really no new method. It owes its special name 
to the nature of the task which it fulfils, viz. the determination of equal- 
appearmg {uebeirmeThhch) sense-distances as distmguished from just 
perceptible {ebenmerJchch) sense-distances The method which it employs 
falls under one or other of the first three headings. 

There are two things, essentially different from each other, which 
are commonly confused under this one heading “psychophysical 
methods,’’ namely the methods of experimenting in order to obtam 
data, and the processes of calculation after the data have been collected. 
To avoid this confusion the words ^^method” and “process” will be 
employed throughout this book in the way indicated by theu use in 
the above sentence. It is urged that their general adoption would be 
advantageous. The cause of the confusion is to be found in the historical 
development of the subject, for with each of the methods of experi- 
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menting a process of calculation was associated and the one name was 
given to both. 

The experimental methods of determining thresholds may be 
divided into two mam groups: 

1, Methods m which the stimulus is altered continuously until in the 
opinion of the subject it fulfils some given condition. 

2. Methods in which various values of the stimulus are separately 
submitted by the experimenter to the subject who expresses a 
judgment on each of them, classifying them into two or more 
categories. 

The methods belonging to the second group may in turn be classified 
according to the order in which the stimuli are submitted to the subject. 
The second group is thus subdivided as follows. 

2 (a). Methods in which the order of succession of the stimuh is 
irregular, non-consecutive 

2 (b) Methods in which the order of succession of the stimuh is 
consecutively (i) ascending or (u) descending. 

Under 2 (a) comes the Method of Right and Wrong Cases. Under 
2 (6) come the Method of Minimal Changes and the Method of Serial 
Groups*. The latter is a special case of the Method of Minimal Changes, 
in which each value of the stimulus is submitted a number of times 
before the next consecutive value is submitted. A corresponding method 
under 2 (a) is the Method of Non-Consecutive Groups, in which groups 
are taken in an irregular order. It is customary in the Method of Serial 
Groups to mtroduce among the stimuli an equal number of ‘‘catch cases, 
in which no stimulus (or stimulus difference) at all is given. This might 
also be done in other methods. Each method can be further subdivided 
according as the subject is or is not warned beforehand of the kind of 
succession to expect. 

The differences which result from the use of these various “methods” 
are clearly due to their different psychological effects upon the subject. 
But we have also to take mto consideration the differences in the 
“processes” of calculation. These, of course, are purely mathematical 
and Ignore the subject altogether. 

* We adopt here the convenient name suggested by G M Stratton who first described 
the method {Psychol Rev 1902, ix. pp 444 — 447). It had, however, been mdependently 
discovered and employed by W. McBougall four years previously durmg his stay m 
Murray Island {Rep, Cambridge Aivthrop. Expedition to Torres Stmits, Cambridge, 1903, 
n. pp. 190—193). 
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(2) THE METHOD OF LIMITS 

In using tins method for the determination of difference limma the 
following mode of procedure is adopted. The variable stimulus V is 
first made equal to or shghtly larger than the standard S, and then 
increased step by step by small increments until the subject finds it 
just perceptibly greater than S. V is increased still more, and then 
gradually diminished until it just ceases to appear greater than S, .The 
mean of the two values of V — S thus obtamed is the upper difference 
limen, 

Pour values, mstead of two, might also be obtamed, viz. for (i) V just 
not perceptibly greater than S, (ii) V just perceptibly greater than jS^ 
(ill) V just perceptibly greater than /S, (iv) V just not perceptibly greater 
than jS; (i) and (ii) being for ascending values of F, (m) and (iv) for 
descending will be the mean of these four values of V — S. 

The lower difference limen, is obtained in a similar way. Both 
limina may be obtamed in the same series of experiments by the 
‘‘method of complete descents and ascents ’’ 

A senes of determinations of each hmen is made and the average 
taken. A measure of scatter (mean variation, say, or standard deviation) 
IS also calculated. Absolute thresholds may also be found by this method. 

The number and size of the increments employed must be adjusted 
to the particular conditions of the experiment. The subject of the 
experiment should be given a certam amount of prehminary practice 
before bemg started upon the work, and introspective reports should be 
asked of him. 

Among the various possible sources of error which deflect the 
subject’s judgment both in this and in the other psychophysical methods, 
two are of special importance. They arise from the temporal and spatial 
arrangement of the compared stimuli, and are called the “time error” 
and “space error” respectively. Thus, in a determmation of the 
difference limen for sound-intensities, the two stimuli, S and F, cannot 
be presented simultaneously. One must precede the other, and in this 
way it may produce a slight degree of fatigue which causes an over- 
estimation of the other, or it may produce the reverse effect of sharpening 
the attention to the second. Thus a time error arises. Again, in experi- 
ments with brightness-intensities or visual extents, where the stimuli 
can be presented simultaneously, a space error arises from the fact that 
the one stimulus must be presented either to the right or to the left of 
the other stimulus, and the subject’s judgment varies accordingly. In 
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experiments with lifted weights both sources of error may be involved. 
These so-called constant errors may be approximately neutralised by 
arranging that m the course of the experiment the standard shall precede 
the yariable or stand to the right of the variable in half the cases and 
follow or stand to the left m the other half — the time or space order, 
or both, being of course changed quite at random in the successive 
hmen determinations. A better plan is to evaluate the hmen, and its 
scatter, for each time and space order separately. This gives us the 
values of the time error and the space error, which are of interest for 
their own sakes. Fechner’s theory of these errors and their measurement 
IS based upon the assumption that the time and space orders of the two 
stimuli, S and 7, exert an influence upon the result which is equivalent 
to a definite increase or diminution in the stimulus- value of one or the 
other, and thus increase or dimmish the value of S F by the amount 
of the time error or that of the space error eg, or by the sum or the 
difference of these two. The time error is positive or negative according 
as the effect of the time order is to increase or dimmish the apparent 
value of the fir st-f resented stimulus. The space error is positive or 
negative according as the effect of the space order is to increase or 
diminish the apparent value of the left-hand stimulus. 

Four principal cases of time and space order are possible, and are 
conventionally numbered as follows* . 

I Standard presented first and to the right. 


II 

99 

„ second 

99 

99 

III 

99 

„ first 

99 

left, 

IV 

99 

„ second 

99 

99 


Employing these numbers as suffixes, we have the equations 


whence 


T = 

T 

j- u 

- 

ei 

+ 62 > 


== 


+ ’ 

T = 

T 

+ 

ei 

"f- 

Tin 
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T 

- 

ei 
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Tx 
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2 




2 




4 


and a similar expression holds for Ti\ and 

2^2 ~ ^«ii ~ ^Miv ■^«in “ 

2^2 — ~ — Ti^ 




* G E. Muller, Die GestchtspunMe und dte Tatsachm der psychophybiscken Meihod^k, 
1904, pp. 67, 71. 

B 
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The errors due to expectation, habituation, fatigue, etc , are neu- 
trahsed or at least reduced to a minimum by determining the limen by 
means of both ascending and descending values of V and averaging, and 
by other special precautions m applying the method. 

The Mathematics of the Method of Limits 

It IS to Professor F. M. Urban that we owe the most complete dis- 
cussion of the mathematical foundations of this method*. 

Let the variable stimulus Y have the values 

^ 1 ) ^25 

Then for constant experimental conditions there will be, Prof Urban 
assumes, for each stimulus a probabihty that a certain judgment (say 
Greater) will be given Let these probabilities be 

Vv Vz^ • 

If the stimuli were arranged in order of magnitude begmning with the 
smallest, then these probabihties will also be so arranged. Let us 
further write q for the probability that this judgment will not be given. 
Then for each q and p we have 

Consider ascents first. A stimulus s is noted as a just perceptible 
pomt if the answer greater is given at s and was not given at any lower 
point m that series. This is a compound event, and its probabihty is 
the product of a number of for the lower stimuh where greater was not 
the answer, and one f for the stimulus s itself where the answer greater 
is returned. Let P represent the probabihty that s will be noted as one 
reading of the just perceptible point, then we have the set of equations 

Px = Vx, 

^2 = ixTz, 


Pn = M2 - in-X Pm 

and the mean of the j‘ust perceptible points will be 

T = -{- S2P 2 “h ^3^3 4 “ *.. + s^Pfi = S {sP)m 

The standard deviation will be given by 

{{s - r )2 P}==S (s^P) - TK 

* See “Die psyoHopliysischeii Massmetlioden,” Archivf. d. ges. Psychologies 1909, xv. 
p 289; “On the Method of Just Perceptible Differences,” Psychol iSev. 1907, xrv. p 244; 
The Appheation of Statistical Methods to the Problems of Psychophysics, Philadelphia, 1908. 
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An example will make the whole of this much clearer. Weights of 
84, 88, 92, 96, 100, 104 and 108 grams were compared, by lifting, with 
a standard weight of 100 grams, and the replies given, which referred 
to the variable weight, were heavier, eqml and lighter. They were 
recorded as follows. 


84 88 

e i 

1 h 

1 1 

i 1 

1 1 


92 96 100 104 

ii h e k 

e h h h. 

1 h h h 

leek 
e h k k 


108 

k 

k 

h 

h 

k 


and so on for 400 rows, the letters h, e and 1 being the mitial letters of 
the answers given The five rows shown in extemo give five readings of 
the ]ust perceptibly heavier point, viz 92, 88, 96, 104 and 96 grams The 
400 of these obtained from the 400 rows were distributed as follows 
(Urban^s Subject I) 

Grams 84 88 92 96 100 104 108 

Frequency 0 7 30 76 106 169 12 400 in all 

The mean of these points is 100*36, which is therefore the directly 
observed threshold of just perceptible positive difference (It should be 
noted that a time error is included which accounts for the nearness of 
this point to the standard ) The standard deviation is 4 35 grams. 

The frequency with which the answer heavier was given at each 
stimulus can also be found from the records The application of Urban’s 
Formula, based on these frequencies is then as follows 


Grams 

5 

9 

? 

q products 

P ' 

Ps 

Ps2 

84 

_4 

•0022 

9978 

9978 

0022 

- 0088 

0352 

88 

-3 

0200 

9800 

9778 

0200 

- 0600 

1800 

92 

-2 

0889 ' 

9111 

•8909 

i 0869 

- 1738 

3476 

96 

-1 

•2222 

7778 

6929 

•1980 

- 1980 

1980 

100 

0 

4133 

5867 

4065 

2864 



104 

1 

8956 

1044 

0424 

3641 

3641 

•3^1 

108 

2 

9400 

0600 

0025 

0399 

0798 

lo96 

112 

3 



1 

0035 

0075 

0225 




sums 4 0108 

10000 

4514 

1 3070 


grams per workmg umt 4 


- 4406 

0001 





16 0432 


3r = i0108 

1 3069 = 0-^ 




1 

O 

84 

1 workmg umt 4 ; 

1 14=0- 





1000432 

1 

0432 

4 working units 





rnmmmrnmmimtmm 

' ongm 

100 

4 56 grams = 0 * 







]00 0432 



See explanation m text to follow 
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The calculated point of just perceptible positive difference is therefore 
100-04 grams and the standard deviation 4-56 grains It will be seen 
that a working origin has been taken at 100 grams, and a working unit 
equal to 4 grams, to simplify the arithmetic. The column headed 
q 'products is the continued product of the q's from the 84 end. The 
JP column IS most quickly formed as the differences of successive 
numbers of the product column. The P’s rise to a maximum and then 
sink again. They represent in fact the cocked hat distribution of 'the 
]ust perceptibly heavier points, and should be compared with the actual 
distribution of the latter The values P really give the distribution which 
would be found were an infinite number of ascents to be made, the 
probabilities of the answer heavier at the different points remaining through- 
out constant at the actual frequencies which are found in these 400 ascents. 

It will be noticed that the P’s do not add up to unity unless the 
amount 0 0025 is included. This quantity gives the probabihty that 
an ascent should be made without obtaining any answer heavier. In the 
example these '']ust perceptibly greater” points are centred at the 
weight 112, since it is necessary to make some assumption as to their 
position. Strangely enough, Professor Urban himself omits them in his 
calculations, causing in some cases quite an appreciable error. This 
dij05culty about the ‘"tail” of the P distribution would not have been 
necessary had the experiments been extended to a point where all the 
answers were heavier. The pecuhar difficulty about this is however that 
the psychological conditions would thereby be changed*. The ^‘tail” 
difficulty will therefore always be present in threshold measurements. 
It causes mathematical troubles m all the methods except only in the 
process of calculation used m the Constant Method, and will be fre- 
quently referred to in this and the succeedmg chapters. 

If the steps between the stimuli are equal, as here, a saving in 
arithmetic which escaped Professor Urban’s notice can be effected by 
using the summation method described on page 19. The sum of the 
q products gives the distance of the threshold from the end stimulus. 
If the equal increments between the stimuli are not unity but x, the 
sum of the q products must first be multiphed by x The standard 
deviation can also be obtained by a further application of the summation 
process ; the details are left to the reader who should consult the next 
chapter. The consideration of this point here might lead us too far 
from the main argument. 

* See inter aim the article “On Judgments of Like,*’ Frank Angell, Am. Joum.. 
Psychol. 1907, xvm p. 253. 
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In the same experiment the points ol ^just not perceptible difference 
were distributed as follows: 

Grams 84 88 92 96 100 104 108 

Frequency 0 8 36 99 200 35 22 400 m all 

Of these the mean is 98*84 grams, and the standard deviation 
4*02 grams. The apphcation of Urban’s Formula in this case gives the 
following results: 


Grams 

8 

P 

p products 

P 

Ps 

i Ps^ 

80 

-5 



0000 

0000 

0000 

84 

-4 

0022 

0000 

0001 

- 0004 

0016 

88 

-3 

0200 

0001 

0068 

- 0204 

0612 

92 

-2 

0889 

0069 

0704 

- 1408 

2816 

96 

-1 

2222 

0773 

2707 

- 2707 

•2707 

100 

0 

4133 

•3480 

•4939 1 



104 

1 : 

8956 

8419 

0981 

0981 

.0981 

108 

2 1 

9400 

9400 

•0600 

1200 

2400 




2 2142 

10000 

2181 j 

9532 


workmg umt 

4 


- 4323 

0459 = 




8 8568 

T-. 

= - 2142 

9073=0-2 



ongm 

108 

workmg umt 4 

•9525=0- 




99 1432 


- 8568 i 

4 working umt 





origin 

100 

3 8100 grams = 0 - 






99 1432 



The mean threshold is therefore 

by the direct method (100 36 + 98 84)/2 =99 60 grams, 
by Urban’s Formula (100 04 + 99 14)/2 = 99 59 grams 

Professor Urban’s own calculated values are slightly different, partly 
because he neglects the tail of the distribution as above explamed, 
partly because of an arithmetical error. 

The practical applications of Urban’s Formula are few, though it is 
occasionally useful m cases where the direct observation of the just 
perceptible points is impracticable*. Its great value lies m the con- 
clusions which it enables us to draw. In the first place it shows clearly 
that the order m which the stimuh occur has no effect on the value of 
the threshold from a mathematical point of view, for the sum of the 
quantities sP is mdependent of their order, and the P’s themselves are 
equally independent thereof. This does not of course mean that a change 
of order of the stimuh will have no psychological effect. There is no 
doubt that the effect of a non-consecutive series of stimuli will be very 

* See eg. G. H Thomson, “Changes in the Spatial Threshold durmg a Sittmg,” 
Br%t Joum, Psychol, 1914, Yi p 438. 
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difierent from that of an ascending or descending senes, inasmuch as 
the latter will arouse feelings of expectation and the lie Professor 
Urban therefore recommends that except when it is specially desired to 
study the results of ascents or descents the stimuli should be arranged 
in non-consecutive order In fact it will be seen that the above described 
simple mathematical process can also be apphed to data collected by the 
Method of Eight and Wrong Cases We have here an example of the 
distinction between methods of collecting data on the one hand and 
processes of calculation on the other The Limiting Process of calcula- 
tion can be apphed to the Constant Method of collecting data. 

Professor Urban however, although recommending non-consecutive 
stimuli, does not recommend that the data should be collected in the 
way usual m the Constant Method if it is intended from the outset to 
apply the Limiting Process On the contrary, instead of keeping the 
stimuh constant throughout the experiment, he advises a frequent 
change of stimulus-senes. For he found, from consideration of the 
results of interpolating and of irregularly spacing stimuh, that the final 
values obtained by the Limiting Process are dependent upon the par- 
ticular stimuh used, in a mathematical way. To free results from this 
bias as far as possible, he recommends the following procedure The 
steps in any one series should be of equal size, and the starting point 
of the steps should be altered from series to series until the whole area 
has been covered. For example, if the spatial threshold were being 
investigated, the stimuli used might be* 

¥iTSt senes 0, 1, 2, 3, 4, 5, 6, 7, 8 centimetres; 

second series 0 1, I 1, 2 1, 3 1, 4 1, 6 1, 6 1, 7 1, 8 1; 

third „ 0 2, 1 2, 2 2, 3 2, 4 2, 5 2, 6 2, 7 2, 8 2; 

tenth „ 0 9, 1 9, 2 9, 3 9, 4 9, 6 9, 6 9, 7 9, 8 9 

The series might of course follow each other in any order. When this 
is done. Professor Urban shows that the final limen arrived at is the 
point where the probability of the response in question is one-half. 
That is, the Limiting Method finds the median threshold! 

A modification of the Method of Limits, which effects a more com- 
plete elimination of the expectation error by the use of catch experi- 
ments,’’ where the variable given is equal to the standard, and which 

* See C H Thomson, “Changes m the Spatial Threshold during a Sitting,” £rtt, 
Jmm. Pi>ychol. 1914, vr pp 435 — 6, where this plan is followed. 

t For other discussions of the mathematics of the Limiting Process and alhed subjects 
the reader may consult articles by Wirth, Urban, Lipps m the Archiuf, d ges Psychologies 
etc. 
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also collects data at a quicker rate than the ordinary Method of Limits, 
IS that known as the Method of Serial Groufs'^, 

Each fixed value of the variable stimulus is presented wuth the 
standard ten times, not in immediate succession, but interspersed at 
random among ten other values of V equal to S, The percentage of 
correct answers given by the subject is noted, and the experimenter 
passes on to the next value of F which is presented along with catch 
stimuli in a similar manner. The value of F which, as presented m this 
way, gives 80 % right answers, is arbitrarily chosen as measurmg the 
limen. Of course this choice of 80 % makes the method measure a 
totally different pomt from the 50 % point measured by the Method of 
Limits, but this is not essential to the method as a method of collecting 
dataf As such it is a very convenient one to use m measuring a large 
number of subjects in mental test” experiments, or with primitive 
people, where economisation of time is essential 

The mathematical theory of this method is similar to that of the 
Method of LimitsJ It has been shown that mathematically the Method 
of Limits is superior, and that the mathematical disadvantages increase 
with the size of group taken For this reason groups of four have been 
suggested instead of ten §. Further, the arbitrary use of the 80 % point 
obscures comparison with the results of other methods The 50 % point 
would be better although it does not allow so large a number of subjects 
to be measured in a short time as does the 80 % pomt, if, as is assumed, 
each descent is stopped as soon as the requued point is reached, and 
a new descent begun. With groups of four, the 75 %, 50 % and 
25 % points can all be noted if tune permits of complete descents 
and ascents (thus giving both the median iimen and a measure of 
scatter, the interquartile range), while if tune pressed, the 75 % pomt 
would be sufficiently comparable with the 80 % point of previous 
experiments. 

As in the Method of Limits, the mathematical foundations are 
unaltered if the groups cease to be m serial order We thus arrive at 

* See Text Book of Expenmenfal Psychology C S Myers, Cambridge, 1911, p 196 
t See Q M. Stratton (Psychol, Jtevieu\ 1902, ix pp. 444 — 447), who says “a detail 
like this, as well as the exact number ot experiments that may best form a group, might 
well be considered as subject to revision m the hght of further experience and not as an 
essential part of the method ” 

J G. H. Thomson, “A Comparison of Psychophysical Methods,” Br%t Journ. Psychol. 
1912, V. p. 212 

§ “An Inquiry mto the Best Form of the Method of Senal Groups,” Bnt Jmm* 
Psychol. 1919, v. pp. 998 — 416, and “The Probable Error of Urban’s Formula,” %b%d , 
1919, VL pp, 217—222. 
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a Method of Non-Consecuhve Groups'^, which has been held by one 
experimenter to be the best method of collecting data 

It may be pointed out in passing that the Method of Groups is one 
winch is naturally employed m other branches of mental measurement 
as well as in psychophysics For example, the widely known Binet Tests 
are given in groups beginning at a group designed to suit a child of very 
young age, and are proceeded with until a certain percentage of passes 
is obtained at some group. Usually however modifications in the foTm 
of marks for tests passed above the critical group are admitted. There 
IS no doubt but that the mathematical foundations of many of these 
devices require examination in the light of the theory of probabihtyf 
It may also be pointed out that as methods of collecting data the 
Method of Serial Groups, and that of Non- Consecutive Groups, especially 
the latter, approach the principle of the constant method yet to be 
described, and indeed their data can very well be handled by the pro- 
cesses in use in the latter method. 

(3) THE METHOD OF AVERAGE ERROR 
In this method the subject is required to adjust a variable stimulus 
so that it seems subjectively equal to a given standard stimulus. In this 
it difiers considerably from the other methods in which the experimenter 
does the adjustment, usually out of sight or even before the sitting 
starts, and the subject expresses an opinion on each stimulus but does 
not alter it. The alternative name of the present method, viz. the Method 
of Production, smtably emphasises this important psychological point 
Mathematically the method presents differences which are mainly 
due to the fact that in this method almost any value of the variable 
stimulus can crop up, whereas in the other methods the experimenter 
customarily keeps to certain steps, so that the results are as it were 
heaped up at certain pomts. 

The experiment is repeated a large number of times — at least 100 — 
and the arithmetical mean of all the obtained stimulus- values is calcu- 
lated. The difference between this mean value and the standard stimulus 
IS known as the crude constant error e It may be either positive or 
negative. A measure of scatter is also found. 

The crude constant error may be partly due to a space error (the 
time error cannot occur in this method), partly to other constant 

♦ Thomson, Brit Journ Psychol 1912, v. p 206. See also Bnt, Journ, Psychol. 1914, 
VI. p. 434, where this method was employed. 

f See Francis N Maxfield, “Some Mathematical Aspects of the Bmet-Simon Tests, ’ 
Journal of Educational Psychology , 1918, ix. pp 1 — 12. 
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conditions*. Let us assume that the experiment is to adjust the length 
of a variable line until it seems to be equal in length to a standard line. 
In this case, the standard should be situated to the right m one-half 
the number of adjustments, and to the left m the other half, either 
alternately or in haphazard order. The results are tabulated in two 
columns, I standard to the right, II standard to the left, and the means 
of these two found separately Half the difference of these means is 
the space error, while half their sum, less the standard, gives the restdml 
constant error. 

In order to give as much definiteness as possible to the task of 
adjustment, the variable should start sometimes shorter than the 
standard, sometimes (an equal number) longer, and the adjustment be 
made by lengthening or shortenmg respectively. Again, the requisite 
amount of shortening or lengthening should be arranged to be different 
on different occasions, but alternating with some degree of regularity. 

The value of the scatter obtained m this method is from a general 
point of view a more important result than the value of the constant 
errors, since it has often been regarded as proportional to the value of 
the difference threshold as determmed by the other two psychophysical 
methods. The truth is that although there is a certain amount of 
proportionahty between the values, this proportionahty is not complete. 
Under certain conditions the two values vary in opposite directionsf. 
It is hardly necessary to point out that the scatter of the individual points 
obtained m the Method of Limits has but little relation to that reached 
by the Average Error Method. They are not entirely unrelated, however. 

The closest correspondence of any is that between the distribution 
of the errors in the present method and that of the judgments equal’’ 
in the Constant Method 

(4) THE CONSTANT METHOD 

This is generally regarded as the most satisfactory of the psycho- 
physical methods. It can be employed with equal convenience for the 
determination of absolute thresholds, difference thresholds, equal- 
appearing sense-distances, and other measurements of psychological 
importance The different values of the variable stimulus to be employed 
are fixed once for all at the begmnmg of the investigation, and are 
presented to the subject a large number of times (say 100 apphcations 

* Cf E B. Titchener, “Expenmental Psychology,” Stndenfs Manual^ n. p. 74* “A 
■constant error is simply an error whose cmdihons are constant; its amount may vary, 
quite considerably, from stage to stage of a long senes of expenments ” 
t This question is connected with the pomt discussed on p 75 et seq. 
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of each) in irregular order, or in a prearranged order, unknown to the 
subject, corresponding to certain precautions If an absolute threshold 
IS being determined, the variable is presented alone, if a difference 
threshold, it is on each occasion preceded, accompanied, or followed hj 
the standard In the latter case, the subject returns the replies greater, 
uncertain or equal, less, with reference either to the standard, or to the 
variable, or to the first presented stimulus, or on some other prearranged 
plan. The percentage of each of these three types of answers is deter- 
mined for each value of the variable used, and recorded (it is also 
advisable to retain the raw data in the form of the actual answers in 
the order given) 

As one illustration of this method, we shall find it convenient to 
refer to a series of results obtained by Eiecker {Zeitschnft Biologic, 
Bd. X.) which has already served in the descriptions of the method 
given by Muller, Titchener, and Myers. Eiecker obtained the following 
results in an investigation of the ''spatial threshold,’’ or threshold of 
two-point judgments of the skin of the lower eyelid 

s (distance between the points of % 

the aesthesiometer m Pans I 0 05 1 1*5 2 3 4 5 6 

lines)* j 

lOOp {% of two-pomt 3 ndgment 8 ) 30 10 14 40 65 80 87 96 100 

30 -20 4 26 25 15 7 9 4 

It will be observed that, with two exceptions, the senes of per- 
centages follows a general law of increase, the rate of increase itself 
increasing at first and then diminishing. The numbers in the lowest 
hne are formed by subtracting each percentage from the immediately 
succeedmg one, and show this uniformity more clearly. The two excep- 
tions are at s = 0 and 5 — 5. At s = 0 the percentage is greater than at 
the immediately succeeding stimulus. This irregularity is known as an 
inveuion of the first order. The cause of it is doubtless to be looked for 
in the exceptional way in which the stimulus (one point) may have been 
applied, the pressure and general nature of the contact may have been 
different from what they were with two-point contact, or some mis- 
leading suggestion may have accompanied these particular experiments. 

At 5 = 5, the percentage is indeed larger than that for 5 = 4 and 
smaller than that for 5 = 6 , but reference to the differences shows that 
the increase from 4 to 5 is greater than the increase from 3 to 4, thus 
breaking the general rule as regards rate of increase. This irregularity 
is known as an inversion of the second order, and bemg in the present 


* A Pans line =2 25 mms. 
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case slight, is probably to be explained as due to an insufficiency m the 
number of applications of the stimulus. 

As a second example, m this case one dealing with a difference 
threshold, we shall take the data for lifted weights which have already 
been used on p. 51 in connection with the Method of Limits The 
standard weight was 100 grams and was lifted before each of the seven 
comparison weights. The judgments given were lighter than, equal to, 
or heavier than the standard. With Subject I the answers heavier were 
distributed as follows, in 450 trials with each weight* 

Comparison weigiit s 84 88 92 06 100 104 108 grams 

Answers heavier 1 9 40 100 186 403 423 

Proportions p 0022 0200 -0889 2222 4133 8956 *9400 

The third row of this table is simply the second row divided by 450*. 
A figure of the quantities p forms a curve which, followmg Galton, we 



may describe as an ogive. It is shown in Fig 7, where however no 
attempt is made to draw a smooth curve through the points, which are 
merely jomed by straight lines 

Here there are no inversions of either order, and the example is 
therefore a more convenient one for a first explanation of the various 
processes of calculation which may be adopted We shall for this reason 
deal with it first, returnmg later and considering Eiecker s more irregular 
numbers. 

We must commence by defining the limen, and do so in the first 

♦ TMs figure is correct But (as stated on page 51) Urban only gives 400 values of 
the just perceptibly heavier points, we are unaware of the reason winch led him to discard 
the other 60. 
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place as the point corresponding to 50 % of the judgments in question. 
For example, m our case we define the limen for the response heavier 
as being the point where the subject would give half his answers heavier^ 
the other half being lighter, equal, or whatever other answer is allowed, 
but not heavier Above this point he is more likely to answer heavier 
than not, below it he is more likely not to give this reply. 

The hmen corresponding to 50 % heavier judgments may be calcu- 
lated m two general ways (A) from the observed values, (B) by finding 
the best fitting smooth curve, adjusting the observations to this, and 
then calculating the constants (mean, mode, scatter, etc ) from the curve. 

A (1). Linear Interpolation 

The required hmen obviously falls somewhere between 100 grams 
(41*33 % answers heavier) and 104 grams (89 56 % answers heavier). 
A very simple way therefore of determining its value is to assume these 
points joined by a straight hne, as in Pig. 7, and find where this hne 
cuts the 50 % line. Arithmetically this means finding a weight which 
divides the interval from 100 to 104 grams in the same proportion as 
50 % divides the interval between 41*33 % and 89*56 %. If T be this 
weight, we have then 

r - 100 _ 50 -- 41*33 
104 - Y ” 89*56 - 50 ’ 

and with practically no calculation we obtain the value 100*72 grams 
for the hmen. 

This method though commendably simple is open to several ob- 
jections: 

(1) It does not employ all the data ; it uses two of the percentages 

only 

(2) The assumption that the curve is a straight line at this point 
IS unlikely to be exact 

(3) It gives no measure of scatter. 

A very simple extension of the above idea has been suggested* 
which obviates the third and to some extent the first of these objections. 
This is to calculate the 75 % and the 25 % points by the same simple 
form of hnear interpolation as that employed for the limen itself, that 
IS, on the Fig. 7, to find where the zig-zag ogive crosses the *25 and 
•75 hnes. These distances are readily found by a short calculation 
to be 96*58 and 102*79 grams respectively. Half the interval between 

* Q- H. Thomson, “A Comparison of Psychopliysical Methods,” Br%t. Joum. Psychoh 
1912, V. p. 210 footnote 
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them, namely 3*10 grams, is the semi-interqaartile range, a rough but 
very practical measure of scatter. 

The fact that the 50 % pomt is not half-way between the 25 % pomt 
and the 75 % pomt is a rough mdication of the skewness of the data 
it divides the interquartile range in the proportion 4-14 grams below 
and 2*07 grams above 

Moreover, it will be found that in practice the mean of the three 
values, the 25 %, 50 %, and 75 % points, gives a fairly good approxi- 
mation to the threshold found by more comphcated calculations assummg 
a symmetrical distribution In the present case this gives 


96-58 + 100 72 + 102-79 
3 


100-03 grams. 


A (2). The Anthmetical Mean^ (Spearman^ s Formula) 


A value which can be calculated by a use of all the data is that of 
the mean or average hmen. Before proceeding to consider this, it is 
important to realise clearly the fact, which G E. Mullerf was the first 
to point out and emphasise, that a limen is a variable magnitude 
following a law of frequency-distribution There is no fixed hmen, only 
an average hmen, a most frequent hmen, or a most representative hmen. 
The p’s m the table (p 59) represent the relative frequency of hmma 
for stimuh below the correspondmg s Thus there were 41-33 % hmma 
below 100 grams, and 22-22 % hmma below 96 grams, i.e there were 
41-33 — 22-22 or 19-11 % hmina between the limits of stimulus-values 
96 grams and 100 grams This suggests the plan of plottmg a frequency- 
polygon or histogram for the hmma using these differences of the p’s. 
For the present case the table of differences runs 


Below 


Above 


84 grams 1, or 0022 of the whole 


8^88 „ 

8 „ 

0178 

» 

88—92 „ 

31 „ 

0689 


92—96 „ 

60 „ 

•1333 

» 

96—100 „ 

86 „ 

•1911 


100—104 „ 

217 „ 

4823 


104r-108 „ 

20 „ 

0444 

,, 

108 „ 

27t „ 

0600 

»> 


* “The Method of Eight and Wrong Cases without Gausses Formulae,” Brit Journ» 
Psychol 1908, n. pp 227—242 

f This at least is the view to which Muller himself mclmes {OestchtspunUe, p 59), 
but he deduces his formulae on the assumption, supported by Fechner and Bruns, that 
the threshold has a smgle defimte value, subject m the course of an expenmental deter- 
mination to variable apparent increase or decrease by random influences which obey the 
Normal Law of error He pomts out that both views lead to the same formulae Indeed 
the distmction is merely a verbal one, m our opmion. 

X This IS not necessarily an inversion of the second order, for it may be spread out 
to any distance above 108 grams. 
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and the histogram, or pseudo-histogram* as it is safer to call it, is given 
in Pig 8 

If we now wish to proceed to the calculation of the mean of these 
limina we must decide where to centre those which lie between say 
92 and 96 grams. If we take this centre as the actual midpoint of each 
mterval, then Sheppard has shown f that errors on one side of the mean 
tend to balance those on the other, and no further correction is required 
This plan Professor Spearman followed in the first of two alternatrves 
which he discusses, and it is the plan adopted here and referred to when 
Spearman’s Formula is spoken of In his second alternative Professor 
Spearman proposed another plan with the correctness of which we do 



Fig 8 Ps6ti<io-1nstograiiii of tlie 450 lunina XJrban’s Subject I, answers hcdvisT 

not agree and concerning which Professor Spearman while defending its 
accuracy informs us in correspondence that it is in his opinion superfluous 
as the first plan is near enough. 

A real difhculty, and one which robs the method of much of the 
practical utility which it would otherwise have, is the mpossibihty of 
fixing in any unambiguous fashion the centres of the tails of the distribution, 
that IS those hmina which in our example he below 84 and above 108 
grams respectively. This is the same trouble as that referred to on 
p. 52 m cozmection with the apphcation of Urban’s Formula. 

* See later, p 79 

t Cf, e g W. F. Sheppard, “On the Calculation of the most probable Values of Fre- 
quency Constants,” Proc. Loud Math Soc, xsix. pp. 353 
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The simplest thing to do is to assume that at 80 grams the subject 
would never, and at 112 grams would always, have answered heavier, 
i,e to centre the tails at 82 and at 110 grams respectively We shall 
do so in this case, although it is clear that at the upper end the tail is 
probably more spread out than this. We then have the following calcu- 
lation for the mean or average hmen ; 

1 at 82= 82 

8 „ 86 = 688 
31 „ 90= 2790 

60 „ 94= 5640 

86 „ 98= 8428 

217 „ 102=22134 
20 „ 106= 2120 
27 „ 110= 2970 

44852 total 

Dividing this by the whole number of limina, 450, we obtain 99*67 grams 
as the threshold by this method. The standard deviation can also be 
found, o* == 5 1 grams (but see next chapter for a correction to this 
value, known as Sheppard's adjustment). 

The summation method of finding the mean, which is explained on 
p. 19, again enables a saving in arithmetic to be efiected in this calcula- 
tion. Apphed directly to the frequencies p it works as follows in the 
present case, and obviates the actual formation of the pseudo-histogram. 


Frequency of answers heavier at 84 grams 

•0022 

tt 

„ 88 

9f 

•0200 


„ 92 

>9 

0889 


„ 96 

99 

•2222 

n 

„ 100 

99 

•4133 

>j> 

„ 104 

99 

•8956 

99 

„ 108 

9) 

9400 




2*5822 sum 




4 gram units 




10 3288 

This must be subtracted from origin 

110 




99 6712 grams threshold. 


The reader must be referred to a study of the summation method on 
p. 19 to realise why in this case the sum obtained has to be subtracted 
from the origin. 

We can at this point call attention to an instructive comparison 
which can be drawn between the Method of Limits and the Method of 
Bight and Wrong Cases, as regards the processes of calculation employed 
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in them, on the basis of Urban’s Formula for the former and Spearman’s 
Formula for the latter'’* * * § . 

Urban’s Formula, S (sP), shows the threshold as the mean of a 
number of ]ust perceptible points, which are centred at the stimuh used, 
the quantities P bemg the differences of successive products of the 
frequencies of the answers heamer (or not heavier) 

Spearman’s Formula, as exemplified m the above calculations, can 
be written S where df is the difference of the successive ire- 

quencies and shows the threshold as the mean of a number of limina 
which he between the stimuh used. 

B. Methods which jit smooth curves to the data 

The idea underlying these methods is to run a smooth curve through 
the points of Fig, 7 (the p values) instead of simply joining them by 
a zigzag, and then to ascertain where this smooth curve, which does 
not necessarily go exactly through any of the points but smooths off 
any inequahties, passes the 50 % hne. Any smtable curve which 
happened to occur to one might of course be employed. For example, 
a parabola of high order can be used*f, and the curve tan“^ 6 has also 
been triedlf. But clearly the whole experiment suggests that an error 
function of some sort is wanted, and as early as 1860 G. T. Fechner 
suggested! that such numbers formed the integral of a Normal Curve 
of Error. 

This idea would naturally occur to anyone accustomed to handling 
the Normal Curve on considering the pseudo-histogram or table of 
differences, Fig. 8. The obvious skewness of the diagram would also 
strike such an observer, it may be noted in passing, but with this pomt 
we shall deal in a separate chapter. 

The obvious way to fit such a histogram with a Normal Curve is 
that given m the previous chapter, namely, to find the mean and the 
standard deviation, and use these constants in the expression for the 
curve. To this there are however important practical objections, the 
chief being the difficulty of the undefined tails, to which reference has 

* G H Thomson, “A Comparison of Psychopliysical Methods,” Brit Journ, Psychol. 
1912, V. p 226 

f S’. M. Urban, **I)ie psychophysischen Massmethoden als Gnindlagen empinscher 
Messungen,” Archivf d ges Psychologie, 1909, XY and xvi. pp 33o — 355. 

t Urban, loc ctt. p, 393 et seq 

§ G. T Fechner, Mlemente der PsycTiophysth, 1860. 
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already been made in discussing Spearman’s plan of finding the mean. 
This difficulty is still more acute when we attempt to find the standard 
deviation This tail difficulty does not occur m the plan adopted by 
Muller*, which fits the Normal Integral direct to the p values, not 
troublmg at all about the differences forming the histogram. In other 
words, Muller’s process fits a curve to Eig 7, not to Fig. 8, and is 
therefore more direct, in addition to the advantage it has of avoidmg 
the tail problem. 

Before proceeding to the explanation of Muller's process, it is 
necessary to notice that he employed a shghtly different form of the 
equation to a Normal Curve from that used in the previous chapter. 
The latter is the form now m general use among biometricians, and it 
seems desirable that it should also be used by psychometricians, who 
otherwise would be hindered from the direct application to their work 
of the mathematical improvements made by the biometric school, and 
especially would find their use of the valuable tables published by 
Professor Pearson much hampered In the actual description of Muller’s 
work however it is better for the present to keep to his notation in this 
respect. The form of the Normal Curve used by him was 




V(^) 


-Tf 


In this s is the variable stimulus, T is the average limen, and therefore 
also, since the curve is symmetrical, the median and the mode So far 
the notation agrees with that used in the expression employed for the 
Normal Curve in the previous chapter, namely 






a^/{27T) 

but a further comparison of the two shows that for his second constant 
Muller has a quantity 7^, wbich is connected with the standard devia- 
tion a of the biometric formula by the relationship 

1 




2a2* 


When the standard deviation is large, therefore, li is small. It is a 
measure of 'precision, not of scatter. 

The assumption is now made that the relationship between the 

♦ G E Muller, “Ueber die Maassbestimmungen des Ortssinnes der Haut mittels der 
Hetbode der nchtigeu und falscben Eaiie,’* JPfluger^s Archt fur die ges Physiologies 1879, 
Xis. pp. 191 — 235, especially par 5 et seg^i also Die Gesicktspunkie und die Tatsacken 
der psychophysischen Methodik, Wiesbaden, 1904, par 11, where the classical description 
of this method will be found. 


B. 8c T. 


6 
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stimulus s, and the frequency f with which the answer heavier is returned, 
IS given by the equation 

j-00 VW 

That IS to say, it is assumed that the successively increasing percentages 
of answers heavier correspond to the increasing area of the portion of 
a Normal Curve which is shaded m Fig 9, as the point s moves to 
the right in that figure 

To obtain this equation in a more convenient form for our purpose, 

his-T) = t (2). 

This corresponds to measuring the stimuli in a special unit, and is the 



same device as that used m another connection later by Galton. The 
equation then becomes 

1 rh(s-T) 

’’-■ml-. ' 

By inserting m this equation the corresponding values of p and s 
from the table of data on p. 69, we obtain seven equations for two 
unknowns h and Y, and as these equations are shghtly inconsistent with 
one another we have to decide how to calculate the most probable 
values of h and T, No pair of values will exactly satisfy all seven 
equations Instead of coming to zero they leave small residuals v. 
Muller adopted the Method of Least Squares, an account of which will 
be found on p. 44 in Chapter II. 

In passing a note must be made of the fact that Muller assumed 
tacitly that these observation equations, being each based on the same 
number of experiments, are of equal importance or weight*.’’ We shall 
allow this assumption to pass for the present but shall return to it later. 

Unfortunately, the equations are very far from being simple and 

* There is unfortunately a possibility of ambiguity her© owing to the fact that 
vmghts are used as stimuli. 
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linear as m tlie example on pages 44 and 45 To avoid this difficulty, 
we look up m tables of the Probability Integral* those values of 

y^h{s^T) ... (4) 

which correspond exactly to our values of 'p 

These equations are not yet linear in T and h, though much simpler. 
If however we write c = hT, 


they become y — & 4- c = 0 (5)t 

and are now linear in h and c If we now insert any pair of values 
Ji and c into these seven (or in general, n) equations, these also will 
leave residuals % diflerent from those considered above in connection 
with the equations (3). If we were now to proceed to make S (u^) 
a minimum, this would not efiect our purpose. It is S we wish to 
make a minimum, not S (u^) If however we can find multiphers or 
^‘weights’’ M such that each 

Mu^ = v\ 

then we can make S (Mu^) 

a minimum. That is, we can apply Least Squares to the equations (5) 
weighted with certain artificial weights (in addition to any weights 
which may possibly be necessary by reason of there being different 
numbers of experiments at the different stimulus- values). The use of 
this device of artificial weights to overcome the complexity due to the 
non-linear equations is Muller’s particular credit in this connection 
Clearly the residuals v, which may be regarded as errors in p, are 
connected with the residuals w, which may be regarded as errors in y, 
by the equation 1 

VW’ 

from equations (3) and (4). Therefore 

M = 

Herein we can omit the ■jt since it is only the relative values of the 
Muller weights which are of importance These weights are, by reason 
of the improved weights to be shortly described, of only historical 
interest. The condition that S (v^) should be a minimum has now 

* The table of the Probability Integral commonly used by psychologists is that known 
as Pechner’s Fundamental Table, which is given in Appendix I. It is desirable that 
psychologists should make the slight changes m notation necessary to enable them to 
use better and more generally accessible tables For example, the first table in Pearson’s 
Tables for Biometnaans and SiatisUciam is, except for a factor \/2, identical in sigmficance 
with Fechner’s, and gives more values, to more decimal places 

t Note that this, hke (3), represents a set of equations, each of this form. In our 
example there are seven such equations. 


5—2 
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become that S (Mw®) should be a minimum. With this substitution, 
the equations (5) give the two Normal Equations 


S (Msy) - S (Ms^) h + S (Ms) e = 0 ] 

S (My) + S (Ms) h-S{M)c==0 J 

Thence we have 

S (Ms) S (Msy) - S (My) S (Ms^) ] 
® “ S{M)S (Ms^) - (Ms) 

, )S (M) N (Msy) - S (Ms) S (My) . 
S (M) S (Ms^) - (Ms) 

T = clh 


.. ..( 6 ). 


( 7 ). 


The use of these formulae is best explamed by an example. Before 
giving one, however, it is well to describe a modification in the weights M 
which was introduced in 1909 by Professor P. M Urban*, as it is with 
Urban’s weights, and not with Muller’s, that we shall actually work 

These alterations m the Muller weights, or rather additions to 
Muller’s weights, which Professor Urban made, arise from the notion 
of the probabihty of a certain judgment, with which we are already 
famihar The analogy is, as it were, between extracting the answers 
heavier or lighter from a subject, and extracting black or white balls 
from a bag containing a mixture of these colours. Compare, for example, 
the two statements. 

(1) Prom a bag containing black balls and white balls, 450 drawings 
are made, one at a time, the ball being returned each time before the 
next drawing is made. 403 black balls are observed out of the 450. 

(2) A subject on performing a certam experiment with lifted weights 
sometimes gives the answer heavier^ sometimes some other answer. On 
one occasion, when the weights were 100 grams standard and 104 grams 
unknown, this experiment was repeated 450 times, and the answer 
heavier was obtained 403 times out of the 450. 

Now if p IS the observed proportion (here 403/450) of black balls in 
a bag, then the probable error of p is known to vary with Vp (1 ~ p), 
or Vp2t* With the same sized sample, a result p= -5 has a larger 
probable error than a result p = -8 say. If anything similar holds, as the 
analogy suggests, for the psychometric experiment, then the seven, or n, 


* “Die psychophysischen Massmethoden,” Archiv /. d. ges. Psychol, 1909, xv and xvx. 
p. 357 et seq, 

t d p. 32, Standard Deviation of the Binomial Expansion Eeally the true values 
of p and q should be used, but this is the best we can do And further, the expression 
probable error ceases to have an accurate meaning when p is too close to zero or umty 
and the distribution is m conseq^uence very skew. But these refinements do not affect 
the argument except m detail. 
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equations (5) are not equally reliable, even thougli based on tbe same 
number, 450, of experiments eacb. In addition to the Muller weights M 
they need other weights 1 jifq to allow for this new variation in reliabihty , 

These weights, it will be observed, arise from the fact that drawing 
balls singly from a bag in this way gives rise to a binomial distribution, 
and the standard deviation of such a distribution is, as is shown on 
p 32 in the previous chapter, equal to Vjig. The combined weights 
Mj4:'pq are known as Urban’s weights, and are also given in a table in 
Appendix I. Professor Urban discusses the matter at some length m 
his already cited article, and a discussion will also be found m Wirth’s 
Psychophysik (Leipzig, 1912), where on p. 151 the actual scatter of 
various p's is given in a diagram. 

The fact that in the above we have taken the weights as proportional 
inversely to the square of the probable error, pq, need cause the reader 
no trouble, for it is the same phenomenon as the fact that the accuracy 
of a set of readings increases with the square root of the number of 
readings made, as follows from p 24. The weight of an observation 
equation in an ordinary sense is simply the number of times the observa- 
tion has been repeated, that is it is proportional to n the number of 
observations, which as we have just said is proportional inversely to 
the square of the probable error. 

Using the symbol W for the combined Urban and Muller weights 
which are given m tabular form m Appendix I, we have to replace M 
by W m the equations (6) These equations we shall now illustrate 
by giving at some length the calculations indicated by them in the case 
of Urban’s Subject I, answers heavier 

We first look up in Fechner’s Fundamental Table*^, i e. a table of the 
probabihty integral, those values of y which correspond to the observed 
values of p These are given in the third column of the adjoining table. 
The fourth column of that table gives the values of the Urban-Muller 
weights Tf , found from the table in the Appendix 


Urhan^s Subject I, Heavier answeis 

Values of 7 and W for substitution in the normal equations 


Stimulus 8 grams 

P 

7 

W 

W8 

84 

0022 

-2 0150 

0 025 

2 10 

88 

0200 

- 1 4520 

0 187 

16 46 

92 

0889 

-0 9528 

0 502 

46 18 

96 

•2222 

-0 5408 

0 806 

77 38 

100 

4133 

-0 1549 

0 982 

98 20 

104 

•8956 

0 8S88 

0 551 

67 30 

108 

•9400 

1-0993 

0 396 

42 77 




3 449 

340 39 


♦ See Appendix I 
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From this table ;S (IF) is at once obtained, and the other quantities 
appearing in equations (6) are easily formed, though the arithmetic 
is laborious. The work for S (TFs) is given in the last column of the above 
table, and the other quantities are obtained similarly. They prove to be 

S{W)= 3-449, 

S (Ws) - 340 39, 

S{Wsy)^ -- 31-223, 

S (Wy) - - 0-463, 

^(1^52)== 33700-1. 

The equations (7;, reading W instead of M, then give 
Threshold 2" = 99 68 grams, 

Piecision h == 0-136113. 

The standard deviation corresponding to this precision is 
and •6745a = 3-5 grams. 

The fact that 99-68, which is thus found for the threshold of answers 
heavier^ is actually smaller than the standard 100 grams than which it 
is judged heavier, may cause confusion if it is not at once explained 
that this value involves a time error 

It will be seen that the Constant Process as described above and as 
illustrated by this example, involves a great deal of arithmetical work, 
so much so indeed that it is certain never to be used except in some 
special cases, unless plans for easing this labour be adopted. Something 
can be done by usmg the arithmetical short-cuts explained in the pre- 
ceding chapter, and Crelle’s Calculating Tables, or better still a calcu- 
latmg machine, makes the work practicable. But the best device for 
reducmg the arithmetical work involved in the Constant Process is that 
adopted by Professor Urban in publishing his tables for this method. 
These tables are given in Appendix I, and do away with the necessity 
for FechnePs Fundamental Table and the Table of the Muller-Urban 
weights. They assume that exactly 100 experiments have been made 
at each stimulus-value, but of course if other numbers of experiments 
have been made, the p’s can be approximated to by two significant 
figures. Their use will be readily grasped from the worked example on 
p. 73 below: and that example is also employed in Appendix I to 
explain Rich’s useful Checking Table. 
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We give next, as models, the calculations by all the above methods 
for Eiecker’s data, assuming however that no two-pomt judgments were 
given at zero stimulus-distance The data are given on p 58 and it 
should be noted that the stimuli are not equidistant, and that therefore 
summation methods cannot be used to lessen the arithmetical work. 

Riecker’s Data 

(1) Limiting Peocbss. By Urban’s Formula 
(a) Jiist Percephbhj4wo Points 


5 

V 


I q products 

j P 

Ps 

Ps^ 

0 

00 

100 

1 1 0000 

0000 

0000 

0000 

05 

10 

90 

1 9000 

1000 

0500 

0250 

1 

14 

86 

7740 

1260 

1260 

1260 

15 

40 

60 

4644 

3096 

4644 

6966 

2 

65 

35 

1625 

3019 

6038 

1 2076 

3 

80 

20 

0325 

1300 

3900 

1 1700 

4 

87 

13 ' 

0042 

0283 ' 

1132 

4528 

0 

96 

04 

0002 

0040 

0200 

1000 

6 

100 

00 

! 0000 

0002 

0012 

0072 

Sums 

10000 

1 7686 

3 7852 


T == sum of Ps = 1*7686 Pans Lines 
Standard deviation of the just perceptibly-two points, squared, 
= sum of less 
= 3*7852 - 3*1279 = *6573, 


whence standard deviation = *81 Paris Lines. 


(b) Just Impercej)tibly-two Points 


8 

P 

p products 

p' 

P's 

P's^ 

0 

00 

0000 

0024 

0000 

0000 

05 

•10 

•0024 

0219 

0109 

0055 

1 

14 

0243 

*1494 

•1494 

1494 

15 

40 

•1737 

•2606 

3909 

5863 

2 

•65 

4343 

2339 

4678 

•9356 

3 

80 

•6682 

•1670 

5010 

1 5030 

4 

87 

•8352 

•1248 

4992 

19968 

6 

96 

9600 

0400 

•2000 

10000 

6 

100 

10000 

0000 

0000 

0000 

Sums 

10000 

2-2192 

61766 


T' = 2 2192 Pans Lines, 
a' = 1*12 Pans Lines, 

{T -h Y')/2 = 1*99 Lines, 
Mean of the two cr’s, 0*97 Paris Lines. 


whence 
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(2) Linear Interpolation 
for 75 %, 50 % and 25 % points. 


80- 75 3-^2 

75- 65 “ $2-2’ 
65- 60 2 - Y 

50 - 40 “ Y - 1-6 ’ 


$2 = 2 67, 
Y = 1-70, 


40 - 26 1-5 - $1 
25-14 $1 - 1 ’ 


$1 = 1 - 21 , 


$2 - Y = 0-97 
Y - $1 = 0-49 


(skew). 


Interquartile Eange = 1-46. 

Semi-interquartile range = 0'73. 

{Qx + T + Q^jZ = 1-86 Pans Lines. 

Rough value for a, 0‘73/0-6745 = 1-08 Paris Lines. 


(3) Arithmetical Mean (Spearman’s Formula) 


s 

P 


centie s' 

dp X a' 

dp X s'^ 

0 

00 

10 

25 

0250 

0062 

05 

'10 

'04 

75 

*0300 

•0225 

1 

'14 

26 

125 

*3250 

4063 

15 

'40 

25 1 

175 

4375 

*7656 

2 

*65 

15 

25 

*3750 

9375 

3 

'80 

07 

35 

2450 I 

•8575 

4 

'87 

09 

45 

*4050 

1 8225 

6 

96 

04 

55 ! 

*2200 

1*2100 

6 

100 

'00 






100 

Sums 

2 0625 

6 0281 


Threshold Y = 2-0625 Paris Lines. 

Square of standard deviation = 6-0281 — Y® = 1-7742, 
Standard deviation = 1-33 Pans Lmes*. 


* Without Sheppard's correction, for which see p. S4. 
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(4) Constant Process 

using Urban’s Tables. (Appendix I, p 194) 


8 

working s 

V 

W 

yW 

sir 

sW 

syW 

0 

-6 

00 

0000 

0000 

0000 

0000 

0000 

05 

-6 

10 

5376 

- 4871 

-2 6878 

13 4388 

2 4356 

1 


14 

6463 

- 4937 

-2 5853 

! 10 3413 

1 9749 

1*5 

-3 

40 

9768 

1 - 1750 

-2 9306 

8 7916 

5252 

2 

-2 

65 

9473 

2581 

-1 8945 

3 7890 

- 5163 

3 

0 

80 

•7695 

4579 

0000 

0000 

0000 

4 

2 

87 

6215 

4950 

12430 

2 4860 

9900 

6 

4 

96 

3036 

3759 

12146 

4 8582 

1 5036 

6 

6 

100 

0000 

0000 

0000 

0000 

0000 



Sums 

4 8026 

1 5869 

2 4576 

CO 

o 

<£> 

7 4293 





- 1*1558 

- 10 0982 


- 5163 





4311 

-7-6406 


6 9130 


- 7 64 X 6 91 - -431 x 43 7 
4-80 X 6-91 + -431 x 7 64 ~ 


in working units from the working origin 
1-96 

= 3 n— = 2*02 Pans Lines, 

Ji 

4-80 X 6-91 + *431 x 7-64 




4 80 X 43 7 - 7*642 


= *241 in working units, 


whence a = 1/(V2A) = 2*93 working units 

= 1*46 Paris Lines. 

Titchener, using the Constant Process with Muller weights alone 
(the above is with the MuIIer-Urban weights), obtained 

T = 1*88 Pans Lines, 
h = 0*49, 

whence o- = 1*44 Pans Lines. 


Summarising in one table we have 

R%ecker's Data calculated by different Processes 


Process Threshold T Scatter or 

Limiting Process 1 99 0 97 

Linear Interpolation 1 86 1 OS 

Arithmetical Mean 2 06 1 33 

Constant Process 2 02 1*46 


The Probable Error of the Thresholds calculated in these different ways. 
The values of the standard deviation given in the table immediately 
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above refer of course to tbe variation of the individual limina of which 
the threshold T is a central measure If there are n of these individual 
limina, then in an ordinary way the arithmetical mean of these would 
have a standard deviation of a|^/n, The standard deviations of the 
above values of T are indeed of this order of magnitude, say in the 

first case 0-97/V(100) = 097, 


but to avoid misconception ought to be regarded as distinctly la;:ger 
than this* This arises from various causes which cannot here be gone 
into In the case of the Limiting Process there is the dependence upon 
the particular choice of stimuli, m the case of Spearman’s Arithmetical 
Mean formula there is the uncertainty about the centring of the 
‘"tails” of the distribution, etc. 

Professor F. M. Urban, some twelve years ago*, brought forward 
reasons which in his opinion showed that the Method of Limits was 
much more exact than the Constant Method but his mathematics 
contained certain errorsf. The various processes do not differ very 
widely m this respect if each is used in circumstances favourable to 
itself, but on the whole the Constant Process is most rehable, and 
Linear Interpolation least* 

In conclusion, we may venture to express a cautious opinion on the 
choice of a process of calculation from among those given. Frequently 
of course there is no choice, for the conditions of experiment fix the 
matter for us. For example, if the 3ust perceptible pomts have been 
recorded but not the frequencies p of answers of a certain kind at each 
stimulus-value, then the direct Limiting Piocess must be employed. 
We will suppose however that the fullest records have been taken 

If the points at which p = 0 and p = 1, that is the points where only 
one kind of answer is given, are known or are very nearly approached, 
the Arithmetical Mean of Spearman is in our opinion best 

If however, as is frequently the case, these points are unknown, then 
the simple linear interpolation for the 25 %, 50 %, and 76 % points is 
a good plan from the pomt of view of simplicity and is often of sufficient 
accuracy. 

If the accuracy of the data justifies the use of the full Constant 
Process, then Urban’s Tables lighten the work enormously, and give 


* “Die psychophysischen Massmethoden als Grundiagen empmscher Messungen,’” 
Archivf d, gea, Psychol 1909, xv and xvi pp 261 — 415 

t G H. Thomson, “Note on the Probable Error of Urban’s Pormula for the Method 
of Just Perceptible Differences,” Brit Joum, Psychoh 1913, vi. p 217 and “The Accuracy 
of the Phi-gamma Process,” %h^d, 1914, vn. p 44 
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peifect accuracy if exactly 100 experiments have been made at each 
stimulus The great advantage of the Constant Process hes in the fact 
that the ''taiP’ difficulty does not arise. Experiments in which it is on 
psychological grounds inadvisable to employ extreme stimuli can only 
be handled by this process 

But it IS not worth while applying it unless the calculator is assured 
that the experimental accuracy justifies it, and unless he has convinced 
himself, by methods to be described in the next chapter, that the 
distribution is not significantly skew, and the data not heterogeneous 
Very few collections of psychophysical data are worth the accuracy of 
the Constant Process, which is hovrever undoubtedly the best theoreti- 
cally for symmetrical distributions. 

(5) DIFFERENCE THRESHOLDS AND THE PROBABILITY OF A 
JUDGMENT OF A CERTAIN CATEGORY 

A question closely bound up with the mathematics of the psycho- 
physical methods is that of the best measure of a subject’s sensitivity 
to differences of stimulus-value. 

To fix ideas, we shall use the case already discussed of the difference 
threshold for lifted weights. When a sufficient number of judgments 
has been collected, the three categories hgliter. equal or undecided, and 
heavier, are found to occur with varymg frequency with the different 
comparison weights. The difference threshold is then decided by the 
positions of the points T and T' where the descending lighter and 
ascending heavier curves cross the halfway line (see Fig 7, p 59) The 
distance {T — T')j2 or some closely similar quantity is what is called the 
difference threshold, and is commonly used in comparing the sensitivity 
of different subjects. The smaller T — T', the more sensitive the subject 
is said to be. 

This distance however depends entirely on the subject’s readiness 
to give the answer undecided. It measures therefore rather a moral 
characteristic than a physical sensitivity, and varies very much with 
the instructions given to the subject The moral character of the 
measure T — Y' is above all seen from the fact that any subject who 
wishes may reduce it to zero, whatever may be his actual sensitivity to 
differences of weight, simply by determming that he will never give the 
answer undecided 

There is however another measure which has been used. This can 
be most conveniently described by considering first a case in which a 
subj ect gives no undecided answers. In such a case, the thresholds T and T 
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have come together and on the previous plan the subject's sensitivity 
would be considered as infinite, and all subjects giving no undecided 
answers would have the same infinite sensitivity whereas clearly the 
subject’s sensitivity is connected with the rapidity with which the 
curves pass from 0 to 1 or vice versa, and two subjects may difier very 
much in this respect even although they both give no undecided answers. 
Under these circumstances a measure which has been used is the distance 
Q — Q\ the horizontal distance between the crossing of the *25 and -75 
lines (see Fig. 7, p. 59) Under another guise it was used by Fechner also 
for the cases where undecided answers we'ie given. In such cases he 
reduced the three curves to two by sharing the undecided answers 
between heavier and lighter. 

This measure has the advantage that the subject cannot increase 
his apparent sensitivity at will, as was the case with the '^threshold" 
measure. Q — Q' is the interquartile range of the point of subjective 
equality, represented by the crossing of the heavier and lighter curves. 
It and the difierence threshold measure distinctly difierent things, 
and subjects placed in order of merit by the one will be found in a 
difierent order by the other. 

The points here raised seem to suggest an extension of Urban's idea 
of the probability of a judgment, which compares the giving of the 
judgments, heavier, undecided or lighter, with drawmg a ball from an 
urn containing say red, white, and blue balls, and ascertaining its colour. 
For each stimulus the urn is supposed to contain difierent porportions 
of the coloured balls. 

In place of this is suggested the following. For each stimulus 
imagme an urn containing an mfinite number of balls some black and 
some white, m a proportion varying in some way with the stimulus. 
A judgment may then be compared with taking not one but a handful 
of balls from the urn, the hind of judgment depending upon the pro- 
portion of black balls in the handful. 

From this point of view, the standard weight, the variable weight, 
and the physiological make up of the subject decide the proportion of 
black balls in the urn: but the decision as to what proportion is to be 
called heavier, what undecided, and what lighter, depends upon a con- 
scious act of the subject*. 

* See Thomson, Psychol Rev 1920, sxvn. p 300 In a very interestmg reply by 
Eoring {ibid p. 440) to which Thomson regrets that lack of time has prevented an answer, 
but with which he m the mam agrees, it is suggested that “the subject must be both 
instructed and framed to mamtam a constant attitude throughout the experiment,” m 
which case “he will not give doubtful judgments ” References are given to George, Amer. 
Joutn Psychol 1917, xxvm p 1, to Boring, p 465, and to others. 



CHAPTER IV 

SKEWNESS AND HETEEOGENEITY IN PSYCHOPHYSICAL DATA 


Obvious skewness of many psychophysical curves — Pearson’s test for goodness of 
fit applied to the method of average error — Applied to the method of right and 
wrong cases — Skew curves m homogeneous material — The summation method of 
finding moments — Calculation of a skew curve — Analysis into two normal curves — 
Conclusions 

(1) OBVIOUS SKEWNESS OE MANY PSYCHOPHYSICAL CUBVES 
To anyone accustomed to handling distribution data, a most striking 
point about the results of many psychophysical experiments is the 
obvious skewness of much of the data Both the examples used ex- 
tensively in the previous chapter show this very strongly as can be seen 
from an inspection of the data either in numerical or diagrammatic 
form, and also from the various values of the threshold T found by the 
different processes of calculation, for these differences arise largely from 
the fact that the distribution is not normal. 

Taking the best of the processes, the Constant Process, it is of 
interest to see how closely the curve which it gives fits the original data. 
A method of thus estimatmg the goodness of fit of curves has been given 
by Professor Karl Pearson His method is perfectly general, and 
applicable to all classes of curves*, but it has been most fully worked 
out for the fitting of bell-curves to histograms Our problem is not of 
this nature, though it might appear to be so, for the pseudo-histogram 
(Fig. 8) which can be formed from the frequencies p differs essentially 
from a real histogram. Since in psychophysics it may often be necessary 
to fit curves to real histograms, for example those obtained m the 
Method of Average Error, we shall first explain Pearson’s Goodness of 
Fit Test for this case, using the bisection data of Chapter II for the 
purpose (see pp. 15 and 42 and Fig 6). 

(2) PEARSON’S TEST FOR GOODNESS OE EIT APPLIED TO THE 

klETHOD OF AVERAGE ERROR 

The bisection data had a mean of 60-13 mms and a standard deviation 
of 1*38 mms. With these values, using Sheppard’s Tables, we draw the 
smooth curve shown m Fig 6 Now it is important at the outset to 

* Flitl, Mag Jnly 1900, Fifth senes, L pp. 157 — 175. Fhih Mag* Apnl 1916, Sixth 
series, xxxi. pp. 369 — ^378. 
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realise that whether that curve is a good or bad fit to the data depends 
on the number of observations made The number in this case was 
only 29, and it will presently be shown that the curve is a very good fit 
But had the number of observations been 2900 it would have been a 
bad fit, for with such a number of observations the histogram ought to 
have modelled itself more closely to the curve 

In order to apply Pearson’s test, we must find the theoretical histo- 
gram for comparison with the observed histogram That is, we must 
find the areas of the slabs of the curve in Fig 6 which replace the 
rectangles (One of these slabs is cross-hatched in that figure to explain 
more clearly what is here meant ) This is most easily done from 
Sheppard’s Tables by calculating the areas of the smooth curve from 
— 00 up to each dividing ordinate in turn, and taking the differences 
of these numbers, as is done m the following table The quantity 
I (1 -f a) in Sheppard’s Tables is the area of a Normal Curve, of unit 
total area, up to the ordinate xjo. For negative cc’s it has to be subtracted 
from unity* 


Calculation of the Theoretical for comparison with the Observed 
Histogram of the Bisection Data 


X mms 

; x'=x-Q0 13 

i Sheppard's 
x=x'/l 38* 

Sheppard’s 

i(l+a) 

Multiplied 
by 29* 

Differences 

63 95 

3 82 

2 77 

•997 

28 91 

0-09 

0 52 

62 95 

2 82 

2 04 

979 

28 39 

2 09 

61 95 

1 82 

132 

907 

26 30 

5 36 

60 95 

0 82 

0 59 

•722 

20 94 

7 95 

69 95 

-0 18 

-013 

•448 

12 99 

7 33 

68 95 ■ 

-1 18 

-0 86 

•195 

6 66 

4 01 

67 95 

-2 18 

-158 

•057 

1-65 

1 36 

66 95 

-318 

-2 31 

010 

0 29 

0 29 






29 00 


The actual and theoretical histograms are then compared in the next 
table, Pearson’s method, the theory of which cannot be given here, 
then forms the quantity 

2 Q /square of differences of theoretical and observed frequenciesN 
X — um ^ theoretical frequency / ’ 

With this value and n' the number of cells in the histogram, 
Table XII m Pearson’s Tables is then entered and a value of P found. 

* These can be calculated at one opening of Creile’s Tables, or by one setting of a 
slide rule. 
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n' IS here 9 counting in the two tail cells P is then the probability that 
the observed or a worse distribution will be obtained (assuming the 
theoretical distribution) in a sample of the size taken, here 29. 


Calculation of Goodness of Fit of Normal Curve to the Bisection Data 


mms 

Actual observa- 
tions m 

Theoretical m' | 

(m - m'flm' 

Above 63 9 

0 

0 09 

090 

83—63 9 

1 

0 52 

443 

62—62 9 . 

2 

2 09 

004 

61—61 9 

6 

5 36 ! 

076 

60—60 9 

6 

7 95 ' 

478 

59—59 9 

8 

7 33 

061 

58—58 9 

5 

4 01 

244 

57—57 9 

1 

136 

095 

Below 57 


0 29 

•290 


29 

29 00 

1 781 


No. of cells n' == 9 

From Elderton’s Tables, No. XII m Pearson’s Tables^ 

P = 0-998 forx2= 1, 

0-981 for x2==2, 

therefore P = 0-99 approximately. 

In our case we find P = 0 99, i.e 99 samples of this normal distri- 
bution out of 100 would give no better a fit than the present The 
Normal Curve is therefore a perfectly satisfactory theory for these 
29 observations 

(3) PEARSON’S TEST OP GOODNESS OF FIT APPLIED TO THE 
METHOD OP RIGHT AND WRONG CASES 

The above plan of testing goodness of fit cannot however be apphed 
to the pseudo-histogram of Fig S*, The reasons why this is so cannot 
be here gone into m detail, but they are based upon the following 
differences between the two cases. In a real histogram, if any one of 
the cells is larger than it ought to be, then any other must have a 
tendency to be smaller than it ought to be. There is a strong negative 
correlation between the numbers in the cells, a correlation, that is, from 
trial to trial. In the psychometric pseudo-histogram, however, formed 
from the proportions p, this is otherwise, because the p’s are measured 
quite separately from one another. In a real histogram the numbers in 

* G. H. Thomson, “The Critenon of Goodness of Fit of Psychophysical Curves,” 
Biometrika, 1919, xn. pp. 216 — 230« 
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each ceU are necessarily positive quantities. In the psychometric 
pseudo-histogram they may be negative, if the p’s do not rise steadily. 

Psychometrical data of the kind here considered, in fact, as has 
already been pointed out, are not really in histogram form. Although 
a kind of histogram can be deduced from them, it is only by making 
certain assumptions, and the intercorrelations of the cells of this arti- 
ficial histogiam are different from the intercorrelations of a naturally 
observed histogram Under these circumstances we must in applying 
the goodness of fit test turn to the directly observed quantities p. These 
are compared with the values calculated from the Constant Process in 
the following table, the remaining columns of which are explained below: 


Calculation of Goodness of Fit of a Constant Process Ogive 
Urban’s Sub 3 ect I, answers heavier 


Grams s 

Observed p 

Calculated p' 

P-P' 

{p-p'?lp'q' 

84 

0022 

0013 

0009 

001 

88 

0200 

0122 

0078 

005 

92 

0889 

0697 

0192 

•006 

96 

•2222 

•2394 

- 0172 

002 

100 

•4133 

•5246 

-•1113 

050 

104 

8956 

•7972 

0984 

•060 

108 

9400 

•9454 

- 0054 

001 


m=s{ip-pyip'q'} 


= 450 X *125 - 56-25, 

n' = ^ (one more than the number of stimuh), 

P = *0000005 from Pearson’s Tables. 

To these quantities p the principles underlying Pearson’s test can 
be apphed direct. They are indeed the same principles already used in 
Chapter II when we were discussing curve fittmg. We have n quantities 
p which are independently measured, and n quantities p' which are 
theoretically given. The variations of p from p' are binomial in form, 
that IS approximately normal. If we look upon the judgment heavier, 
as suggested m an earher paragraph, as being comparable with drawmg 
black balls out of a bag contammg black balls and white balls in the 
proportions p' and 1 — p', then the probable error of p is 

•6745 ^/{P' (1-pOAK 

h being the number of judgments of which pi are of the category heavier. 

For the chances of ob taming 0, 1, 2, , i -• 1, or i black balls m 
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a drawing of h are given by the terms of the bmomial (p' + 5 ')^^ 9.' bemg 
1 — p' , that 1 S 5 the chances of obtaining 

f ~ 0 /Z;, Ijky , . (A — 1 )/^, Icih or unity 
The standard deviation of the above binomial is Vi^P'9')> ^be 

standard deviation of p therefore Vip' 9' 1^)* The proba- 

bihty of an error p — p' is therefore 

V(27rpY)" 

The probabihty of the whole set of observed values p^, ... p^ 

occurring is the product of n such factors, and is of the form 

z = 

where = S \k 

\ P9 ) 

or if A IS the same at each stimulus, 




ip - P'f 

p'q' 


The remaining columns in the above table calculate this quantity*, 
which is the same as Pearson’s under our special circumstances. 
For we have to use ^ -f 1, because all the n values of p can vary 
separately, whereas in a real histogram the number of variables is one 
less than the number of cells. We thus reach the value P ~ -0000005, 
that IS, the curve is an incredibly bad fit to the data, which cannot 
possibly be regarded as difiermg from a normal distribution by samphng 
errors alone. 


(4) SKEW CURVES IN HOMOGENEOUS MATERIAL 

There are two immediate hypotheses which present themselves to 
explain this bad fit of the normal curve, (a) that the material is not 
homogeneous, the conditions of experiment not having remained the 
same throughout, ( 6 ) that the material is homogeneous, but the under- 
lying factors which cause the distribution of errors or deviations are 
not independent, but correlated, as in the system of generahsed proba- 
bility curves next to be described. A word of caution may first be given, 
for, as we have already suggested, the identification, or even the 
approximation, of graphical representations of ‘^percentage” judgments 
to true frequency-distributions is of extremely doubtful validity. 

♦ A table m Appendix I, giving values of l/(p?), lightens the work considerably* 

B. & T. 6 
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The general theory of curve fitting has been worked out in great 
detail by Professor Karl Pearson'*'. A good account of his method is 
given in a book by W. Palm Elderton, Frequency Curves and Correlationy 
C. and B Layton, London, 1906, to which the mathematical reader is 
referred for fairly complete theoretical and practical information 

Frequency curves of data not involving a mixture of species tend 
to commence at zero, rise to a maximum, and then fall either at the 
same or at a different rate. There is often high contact at one or bpth 
ends of the distribution. An equation of the general form 

^ __ + a) y 

dx'^ ~ f ix) 

satisfies both these conditions, since if ^ = 0 , dyjdx = 0 (high contact), 
and if — a, dyjdx ^0 (maximum, for a maximum, again, the 
second differential coefficient must be negative). Expanding f{x) by 
Maclaurm’s Theorem, we have 

% ^ (^ + g) y ^ 

dx Cq + C-^X -{- ’ 

(1) Putting Cl = Cg == C 3 = . = 0 , we have 

1 dy a 

ydx 

which is the Gaussian or normal curvef It fits the symmetrical binomial 
(I + i)% in com tossing, where the chances for and against are 
equal (p == g), and the contributory causes are independent of one 
another. 

( 2 ) Putting C 2 “ C 3 = ... = 0 , we have 

Idy ^ X a 
y dx^ c-^x ’ 

which represents a class of curves var 3 dng from the Gaussian curve to 
the J-curve It fits the asymmetrical or point” binomial (p + qY, e g. 
m teetotum spinning or dice throwing, where the chances for and 
against are not equal, p = 5 ^ g, but the contributory causes are still 
independent of one another 

* Karl Pearson, “Skew Vanation m Homogeneous Matenal,” PMl Trans 1895, 
onxxxvi A, pp 343 ; “On the Systematic Pittmg of Curves to Observations and Measure- 
ments,” B%omeinka, i. pp. 265 and n. pp Iff, 1901 — 3; “On the Curves which are 
most suitable for descnbmg the frequency of Random Samples of a Population,” 
B%ometr%ha, 1906, v. pp 172 — 6 (an exoeedmgly clear summary of the prmciples mvolved). 
Also later papers m Ph%l Trans 1901, oxcvn. A, pp. 443 — 459, and 1916, being supplements 
to the first mentioned memoir See also pp lx to Ixx in Pearson’s Tables for Statisticians 
and B%omein(nans, Cambndge, 1914. 

t Compare equation (5), Chap. II, p 34 
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(3) Putting Cg = C4 = ... == 0, we have 

I dy ^ X -i- a 
y dx Cq + Cj^x 4- * 

which can be made to represent almost all the frequency distributions 
which may arise. It fits the hypergeometrical series, the successive 
terms of which, e g give the chances of getting Z; — 1, ... 0 black balls 
from a bag containing pn black and qn white balls when i balls are 
drawn"^. 

Here the contributory causes are not independent of one another 
There is no advantage in employing equations which mvolve Cg and 
higher constants, because their use necessitates the calculation of the 
6th and higher ''moments,’’ and these have veiy high probable errors 
Definition, The nth moment coefficient (ix^) of any distribution about 
any ordinate is the sum of the products of the partial frequencies and 



axis of X 


Fig 10 


the wth power of the distances of these frequencies from the ordinate, 
divided by the total frequency. In symbols, if N be the total frequency, 

= j 

The moments are, in practice, first calculated about any arbitrary 
ordinate that is most convenient, and then reduced to moments about 
the centroid in the following way (dashed fi’s represent moments about 
an arbitrary ordinate, undashed about the central ordinate) : 

^ \ 

{x - WfiyZx = N/x/ — nxNfx'n^^ 4 


This gives the general reduction formula 

/ // — ^2'' 

n -1 + /^1 M n -2 - — » 

* The senes is 

,ipn ^ fe 4-l) f, Iqn qn {qn^l) 

71(71-1) ... (71 -A; + 1) I + 21 * ijpn-k + l){pn-k-h2) ***) 

Other series may arise. 

6—2 
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whicli enables ns to transfer any moment from an arbitrary ordinate 
to the mean. Thus we have 

= M 2 ' - Ml'^ 

M3 = Ms' - + 2/^'®, 

M4 = M4' - ^t^i'Ms' + - 3/^'* 

The symbols /x represent moments of the curve, but we have to 
start with grouped frequencies, where the frequencies are assumed to 
be concentrated along the mid-ordinates of the rectangles (cf Fig. 105). 
The moments obtained from these grouped frequencies are denoted by 
vs (dashed and undashed), and corrections are necessary These have 
been deduced by Sheppard* and are consequently known as Sheppard’s 
adjustments. They are 

^2 = 1/2 — 


M4 = »’4 - i»'2 + jh- 

It is generally said that they are only vahd when there is ‘'high 
contact” at the ends of the frequencies, but the equations for /X 2 and 
are probably still valid even without high contact, if the terminal 
frequencies are zero. 

(N B. In workmg, v^'s are changed into ^’s before applymg Sheppard’s 
corrections.) 

It is obvious that vq = 1 and 0. vf is the distance of the mean 
or centroid vertical from the arbitrary ordinate about which the moments 
are first taken, and is conveniently known as d. 

Two very important constants m curve fitting are 


The values of these are always to be calculated, and, withm the limits 
of their probable errors, they fix the type to which the curve belongs 
The general frequency curve equation, written in terms of moments, is 

.r (i^2 + 


a? 4* 0-- 


2 5i32-~6^i^9 


ydx 






X . ^ 


10/32-12i8i-18^ 2 


9’a'^lOA 


-12A 


I — 6 /a^Y 


* W P. Sheppard, “On the Calculation of the most Probable Values of Prequency 
Constants, for Data arranged according to Equidistant Divisions of a Scale,’’ Froc Lmd, 
Math Soc. xxix pp 353 Karl Pearson, “On an Elementaiy Proof of Sheppard’s 
Formulae for correctmg Baw Moments and on other allied Pomts,” Btomeiriha, 1904, m. 
pp. 308 ff 
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This gives at once, for the distance between the mean and the mode, 

-r = - ^V'^i 

2(5^,-6i3i-9) 

(origin IS at mean). 

Hence the curve is symmetrical li — 0 If = 0 and ~ 
curve reduces to the Gaussian or Normal Curve, since the terms in- 
volving X in the denominator of the right-hand side of the general 
frequency curve equation then vanish 

In using the Pearsonian method, then, the order of procedure to be 
adopted is. 

(1) Calculate the moment coefficients about a con- 

venient arbitrary ordinate, 

(2) Transfer to the mean by the equations 

Vg = 

Vg == i/g' ~ SviVg' + 

= 1/4' — 4 ViVg' -h 


(vi' or d is the distance of the mean from the arbitrary ordinate ) 

(3) Determine the corresponding moments for the curve by the 
equations 

= ''2 - A ] 

jLtg == j/g > Sheppard’s corrections. 

IV2 + ■^] 


(N B. For these corrections to be apphcable, two conditions must be 
fulfilled. 

( I ) there must be high contact, 

( II ) the grouping of the frequencies must be equal.) 


(4) Calculate and by the equations 








^ j Pz 2 

1^2 1^2 


These results give the distance of the mean from the arbitrary ordinate 
(vi or d), the standard deviatioti (VjUg), and the mode 


mean — 


O’ (fe + 

2 { 5^2 - b^i - 9) ‘ 


The median is more difficult to determine exactly, but a position 
which is approximate and indeed very accurate in all the curves we are 
likely to meet with m this work, is between the mean and the mode, but 
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nearer to the mean, so that the distance from the mode is twice the 
distance from the mean-** 

Mean Median Mode 

1/3 *^”2/3 

The investigator may then proceed to determine to which of the 
Pearsonian ‘'types’’ the particular curve belongs, to find its equation, 
and to plot it. The type is decided by the constants and ^2 (using 
Diagram XXXV, p. 66, Pearson’s Tables) or by the criterion where 

, ^1(^2 + 3 )^ 

4 (4^2 -3ft) (2^2 -3^-6)’ 

using the following diagram: 


c II if /Sg < 3, 
Type 4 G „ =3, 
IVII „ >3. 



Type in 

n 


The equations to the types are given in detail in Pearson’s Tables^ 
p, Ixhi, or in Elderton {op, where valuable advice on the arrange- 
ment of the calculations will be found. Elderton’s Type II includes 

* Karl Pearson, BtometnJca, 1 1902 — 3, p. 265, Phtl, Tram olxxxvi. A, p. 375; Boy, 
Soc.Proc Lxvm p 369 b C V. L Charher, "Kesearches into the Theory of Probability,” 
Lunds Univermtets Arsshnfti 1905 (1), 1, equation 9 Arthur T. Boodson, “Belation of the 
Mode, Median, and Mean in Prequency Curves,” Biomstrika, 1917, xi p. 425 
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both our Types II and VII, and his Type VII is our G, the Normal 
Curve 

We shall confine ourselves to a fuller description of Type IV, which 
appears to be the type most common in psychometric skewness*. 

It will be clear from the above account that the whole of the calcula- 
tions are based upon the first four moments of the data, and we proceed 
first to describe the most convenient way of finding these when as here 
the stimuli are equidistant, viz the summation method already used 
for finding the mean on p. 19 If the stimuli are not equidistant the 
calculations are rather longer. 


(5) THE SUMMATION METHOD OF FINDING MOMENTS 
IN THE CASE OF DATA AT EQUIDISTANT POINTS 

A full description of this device will be found in Mr Palm Elderton’s 
book already cited, where it is attributed to Mr G F. Hardy. It has 
however been independently used by numerous writers, e g. Lipps, 
Wirth, Urban, etc.f 

The theory cannot be worked out here, but the reader can easily do 
so for himself It is only a question of simple algebra; or from another 
point of view it is the same thing as integration by parts. We give only 
a worked example, Urban’s Subject I, heavier answers. 


Example of the Use of the Summation Method 


Grams 

1 

P 

senes of successive sums 

84 

0022 

0022 

0022 

0022 

88 

0200 

0222 

0244 

0266 

92 

0889 

nil 

1355 

•1621 

96 

2222 

3333 

4688 

1 6309 

100 

•4133 

7466 

1 2154 

! 1 8463 

104 

8956 

16422 

2 8576 

4 7039 

108 

9400 

2 5822 

5 4398 

10 1437 


2 5S22 

5 4398 

10 1437 

17 5157 

1 

1 jSj or d 


s. 

s. 


* Thirteen out of fifteen psychometric curves tried recently were Type IV Cf Pearson 
on zoological and anthropological curves, where Type IV also prevails, PM Tram 1895, 
CLSXXVi A, Part I, pp 388, 403 and 411 

t G. F Lipps, “Die Theone der CoUeetivgegenstande,” Wundt’s Phil Stud Bd xvn 
Separat-Ahdruck, Leipzig, 1902, W Wirth, “Die mathematischen Grundlagen der soge- 
nannten unmitteibaren Behandlung psychophysiseher Besultate,” Wundt’s Psychol 
Siudtm, 1910, Bd. VL pp 141, 252, 430 Urban on Wirth, Archv f, d. ges Psychol xx 
Literaturbencht, p. L 
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The table is self-explanatory. Each column is formed from the 
preceding one by successive summations (from the top m this case), 
and is then totalled*. The origin is here the centre of the group beyond 
108 grams, viz 110 grams, and the unit of measurement is 4 grams, 
measured downwards from 110 grams. We have 

Mean == 110 — = 99*6712 grams. 

Further, it can be shown that the moments 

V2 = 2S3-d(l + (?), 

1^3 = 6S4 - 3^2 (1 + cZ) ~ c? (l-f (?) (2 + (?), 

= ( 1 + (?) + !} 

- j/2{6 (1 + c?) (2 + (?) •- 1} - (? (1 + d) (2 + (?) (3 + (?). 

The work is not heavy up to this point if arranged systematically, 
and in the present case it gives 

^2 == 1*6296, 

1^3 = 0 9645, 

- 9*1621, 

or, using Sheppard’s corrections, 

^42 == 1-5463, (T =: Vm 2 = 1-2435, 
jitg = 0*9645, 

= 8*3765. 

This cr gives in original units 4 x 1*2435 — 4*974 grams, differing from 
the value mentioned on p. 63 because of the Sheppard adjustment. 
From the moments we obtain 

= 0*251, 

A = 3*51, 

= 0*775. 

The type is therefore Type IV ; within the limits of probable error 
of jS^, jSg, and /cg it might however be Type G, VII, or V. Unfortunately 
the ordinary methods of finding these probable errors are of doubtful 
significance in the case of pseudo-histogram data such as ours. We turn 
to the calculation of Type IV. 

* Slightly greater accuracy could, by the way, be attained by using the actual numbers 
of answers heavier and not the proportions p in cases like the present where an awkward 
number of expenments was performed at each stimulus, tiz. 460 , leadmg to recurring 
decimals The totals would then be divided by this number 
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(6) CALCULATION OF A SKEW CURVE (Type TV) 


The equation* is 


'2\ -m - V tan~^ - 


aV 


2/ = 2/o + 

■wherein m = J (r + 2) say, 

where r = 6 - 6) 

r (r - 2) 


a = n 


= rljn say, 


Sh (skewness) = 

Origin, at mean -f vajr; 
mode, at mean — skewness x o*; 


Vo- 


N \/r e 


COS-0 

3r 


JL 

'I2r ' 


(^)P 


a \/{27 t) (cos 


r+l 


tan <f> ■■ 


The actual form of the calculation depends on the appliances avail- 
able, whether Crelle’s Tables, or logantWs, or calculating machines 
Usmg Crelle and seven figure logarithms we get finally, after much 
labour, the following values for the ogive, which has to be obtained 
from the bell-curve by simple quadrature: 


UrharCs Sulject I, Heavier answers 


Stimulus 

Observed p 

Calculated by 
Type rV 

(p -p'flip'g') 

84 

0022 

0046 

0012 

88 

0200 

0184 

0001 

92 

0889 

0690 

0062 

96 

2222 

2155 

0002 

100 i 

4133 ! 

5006 

0305 

104 

8956 

•8078 

0496 

108 

•9400 

9624 

0139 



Sum 1017 


;j ^2 ^ 450 X -1017 = 45 8, P < 0000005 still 


We find therefore that fitting the best Pearson curve possible to the 
data makes practically no improvement in the fit, which is still so very 
bad as to make it quite certam that the data are not homogeneous at 
all The fit cannot be much improved by other assumptions as to the 
spread of the “tail,’’ several of which have been tried The Type IV 

* The notation on tins page is that of Elderton following Pearson, and the symbols 
m,v^n and r have no connection with these symbols used else v\ here in the present book. 
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curve itself is shown, contrasted with the pseudo-histogram, in Fig. 12. 
The mean (99-67), median (99-97) and mode (100-52) are worth com- 
paring, as a matter of interest, with the thresholds obtained otherwise 
(see pp. 53, 60, 63 and 70) 

The reason for the bad fit m this case is, mathematically, the im- 
possibihty of finding a curve to accommodate both the tall rectangle 
217, and the tail of 27, however the latter may be allocated. Much of 
Urban’s other data shows the same bad fit, and for the same reason, ^he 
size of the 'Hails ” Not all however are bad The best case is Subject II 



answers, m pseudo-lustogram form 

(Urban himself) who had had much 'practice at this form of experimenU 
The lighter answers in his case were as follows, compared (1) with a 
curve fitted by the Constant Process and (2) with a Pearson skew curve 
(here Type I). 

TJrharCs Subject J7, Lighter a'nswers 


Grams 

Observed p 

Normal Curve p 

Type I Curve p 

84 

•9333 

•9504 

•9432 

88 

•8622 

•8540 

•8520 

92 

•7000 

•6767 

•6875 

96 

•4489 

4456 

•4627 

100 

•2311 

2320 

*2379 

104 

0956 

•0922 

•0858 

108 

•0156 

0272 

•0187 


On testing the goodness of fit we obtam 

For Normal Curve, P = 0-48* 
For Type I Curve, P « 0*91. 
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Here tlie Gaussian is a good, and Type I an excellent fit. There is every 
reason then to think that the data here are homogeneous The bell- 
curve and pseudo-histogram are shown in Fig 13 

Since we have decided that the data of Urban’s Subject I are hetero- 
geneous, that IS, that the conditions of the experiment varied consider- 
ably during its performance (which lasted several months), the question 
naturally arises as to whether we can analyse the data mathematically 
into two or more frequency-distributions. This question was discussed by 
Professor Pearson in 1894* as far as an analysis into two normal curves 
goes One more moment, /LI 5 , is needed and as the probable error of this is 
considerable the practical apphcation of the plan to be described is not 
very satisfactory. 



80 84 88 92 96 100 104 108 

Pig. 13, A Type I curve Urban’s Subject IT, UgUer answers 

(7) ANALYSIS INTO TWO NORMAL CURVES 


Stage /. Find the centroid of the frequency curve and calculate 
fig, fi 4 > M'S. -^4 and A5. ^ _ 3 ^^^ 

\ = 3O/X2M3 ~ ^Ms- 

Stage //. Solve the following nomc equation for pg losing Sturm’s 
functions to locahse roots: 

24p2" - ( 24 /X 3 A 5 - lOA/) fi 

— (148p3^A4 -b 2 A 5 ^) -f (288/i3^ — 12 A 4 A 5 /X 3 -- A^®) 

+ {24p3^A5 ~ + 32p3^A4P2 — 24/i3® = 0, 


and find p^ from 


W "" ^4P2 -b 


* Phil Tram. Boy Soc. London ^ 1894 
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Stage III. Find and the roots of 

/ - Piy + Pa = 0. 


kyj and hy^ are the positions of the axes of the normal component curves, 
where h is the unit of length. 

Stage lY, The fractions % and that the areas of the component 
curves are of the area of the whole curve, form the roots of the quadratic 




Z — 




Vi - 4pi 


= 0 . 


Stage F. The standard deviations are found from 


<j^jh^ = /i2 - - l^iyi + 

- Wri - IPiya + Pa- 

In the case of our curves, the fact that the tails are only known as 
to area and not as to distribution makes this procedure hardly worth 
while, for the value of /zg, which in any case has a high probable error, 
depends here to a very great extent on how these tails are allocated 
Trials however have shown that the decrease in the value of ')^ obtained 
by dissecting into two normal curves is only very shght indeed The 
heterogeneity is more complex than can be thus dealt with 

Note, 1924. In the Am Journ Psychol 1923, F M Urban suggests, and S W Fern- 
berger carries out, calculations on some of the latter’s data for the purpose of testmg the 
suggestion made on p 90 above, by Hoismgton in Am Journ Psychol 1917 (and, Urban 
might have added, by himself much earher), that practice brmgs about an approximation 
to the normal curve of distribution, or ( 7 ) hypothesis as American writers call it The 
calculations were m favour of this being the case In the same Journal in 1920 E G Bormg 
published an important article on the logic of the normal law m mental measurement, to 
which an equally important reply by T L Kelley appeared m 1923 Boring, who rightly 
demes any inherent virtue m the normal distribution, is particularly concerned about the 
impossibihty of everything bemg scattered m this way As he says, the cubical crystals 
of common salt caimot be normally distributed both as regards height and as regards 
weight, smce the latter measure is proportional to the cube of the former Attempts to 
force mental measurements to fit a normal curve and thereby to deduce a system of umts 
find Bormg sceptical Such attempts were made by Galton and by Pearson and more 
recently by Xrabue and others m America where McCall with his ‘‘T-scale” has given the 
device wide popularity. 

As a consequence of his rejection of the normal curve Bormg rejects all psychological 
units except ‘‘sense-distances.” We are left then, he says, with rank-orders, medians, 
quartiles, contmgencies and correlation-ratios mstead of measurements, averages, standard 
deviations, coefficients of correlation, and Imear regression Kelley however retorts that 


Figures 14, 22 and 23 which appeared here and on pages 124, 128 in the previous 
edition have been omitted, but remaining figures retain their onginai numbers. 
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(8) CONCLUSIONS 

Furtlier analysis is useless For since there are only seven points 
given by experiment in the curve, and also the total area, it is clear 
that an exact fit could be obtained by two skew curves, or a skew and 
a normal, which have between them eight constants, or in many ways 
by three normal curves 

All we can say is that this subject’s sensitivity oscillated between 
at least two states, and if only two, then one of these is such as to give 
a skew curve. Without attempting to get an exact fit, it is clear after 
our experience, that provided we supply a flat normal curve to give 
the awkward tails, the surplus of the distribution could be fitted success- 
fully by a skew curve 

This suggests that the two components into which the heterogeneous 
data are thus divided are (a) a component due to erratic answers giving 
a wide shallow distribution and (b) a component really corresponding 
to the conditions of the experiment 

The use of ‘"catch” tests m threshold determination is to check 
component (a). The proper way to employ them is to cancel sittings 
at which numerous catch errors occur, the subject being then pre- 
sumably m an abnormal state. 

In Riecker’s experiment many “catch errors” were present, ie 


a correlation ratio involves standard deviations, so it too must go, if Bonng is to be con- 
sistent and by less obvious but as I tbink valid arguments shows that none of the other 
measures retained by Bormg is entirely free of those things that he mveighs against In 
the second part of his paper Kelley considers m more detail what are the defensible bases 
for detennining the units of a mental scale He anticipates that much greater difficulty 
wdl be experienced m determining a homogeneous ordered series than in scalmg it after- 
ward, and lets fall the mteresting hint that he hopes at a later date to offer criteria for 
determining if a number of mental tasks mvolve one or more quaktatively different mental 
functions, a problem identical with or at least similar to that discussed m Chapters ix and s 
of this book 

In the second part of his article Kelley suggests four umts of value in mental measure- 
ment (a) the sensed difference umt, (b) the variability m performance umt, (c) the group 
variability unit, and (d) the umt resulting m the simplest picture of mterrelationships, as 
e g stretching and compressmg units till regressions are linear 

Very mterestmg is Kelley’s method of amvmg at a psychometric function bv successive 
approximations If the first guess is right it will lead to the same measure of ab whether 
the standard stimulus he a, 6, c or d The wrong guess will give different values of ab 
which Kelley averages and he uses this, and the averages of ac, ad, etc , as pomts on a 
better psychometric function from which he agam goes thiough the same procedure and 

so OJQU 
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occasions when the sub] ect answered two to a one-point stimulus Pitting 
the best normal curve to his data, we only get, on testing its goodness 
of at, P = -0003 

RiecLer^s Data 

Mean 2 02, a- = 1 46 Pans Lines 


Pans 
Lines s 

Observed p 

5-2 02 

5-2 02 
146 

Gaussian p' 

p-p' 

{p -p'fjp'q' 

0 

00 

-2 02 

-138 

0S4 

- 084 

09S 

05 

•10 

-152 

-104 

149 

- 049 

•019 

1 

•14 

-102 

-0 70 

242 

- 102 

057 

1 5 

•40 

-0 52 

-0 36 

•359 

041 

•007 

2 

•65 

-0 02 

-0 014 

•494 

•156 

097 

3 

80 

0 98 

0 67 

•749 

051 

•014 

4 

87 

1 98 

136 

913 

- 043 

023 

5 

96 

2 98 

2 04 

979 1 

- 019 

018 

6 

1 00 

3 98 

2 73 

997 

003 

003 


Sum *330 


x2=:100x 330, w' = 10, P= 00031 

Compare with this the following case The data are for the spatial 
threshold on the forearm*, and were gathered by the Method of Non- 
Consecutive Groups Sittings containing more than a certain number of 
catch errors were rejected, the number chosen being one which when 
exceeded at all was usually exceeded violently. Other experimental 
precautions were taken which are described in the articles cited. As a 
result it is found that a roughly fitted Normal Curve is quite a fair fit, 
for in 13 out of 100 cases a worse departure would be got by chance: 
and a skew curve would improve this. The data are in fact reasonably 
homogeneous. (Calculations on opposite page.) 

The conclusion of the whole matter is that we are led to believe that 
the difficulties of psychophysical experiment are such that homogeneity 
in the data is rare. For such data refinements of mathematical calcula- 
tion are out of place. The curve fitting methods here described are 
however of value in discovering the heterogeneityf. 

With increasing precautions in carrying out the experiments and 
with increasing practice on the part of the subject, it would appear that 
the data finally reach a distribution where they are fairly well fitted by 
a Normal Curve, and excellently fitted by Pearsonian Skew Curves 

* Cr. H. Thomson “A Comparison of Psychophysical Methods,” Brit Joum. Psychol 
1912, V. pp 203 — 241; “Changes m the Spatial Threshold at a Sittmg,” Bnt Journ, 
Psychol 1914, VL pp. 432 — 448 and J5.A Meport, 1913, pp. 681 — 683 

t Compare Urban’s use of the Lexian Coefficient of Dispersion (op cit.) and compare 
the latter mth Pearson’s more significant criteria and the diagram (XXXV 

in his Tables) 
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Normal Integral fitted, to Thomson's Spatial Threshold Data 


Cms 

TwO'pomt 

answers 

Contmued 

sum 

Cms from 
mean 

In O' 
umts 

Theoretical 
p' from 
Sheppard 

Observed p 

'(p-pT/pY 

0 

52 

5 2 1 

-2 44 ' 

-2 29 

Oil 

035 

05293 

i 

6 

11 2 

-194 i 

-1S2 

034 

040 

00109 

1 

8 

19 2 

-144 ! 

i - 1 35 

089 

053 

01599 

n 

21 

40 2 

-0 94 ! 

1-0 S8 

189 

140 

•01565 

2 

56 

96 2 

-0 44 

-0 41 

341 1 

374 

00485 


84 

180 2 

0 06 j 

0 06 

524 

560 

00521 

3 

105 

285 2 

0 56 1 

0 52 

698 

700 

00002 

3i 

125 

410 2 

106 ’ 

0 99 

839 

834 

00018 

4 

141 

551 2 

156 

146 

928 

940 

00216 


144 

695 2 

2 06 

i 193 

973 

960 

00644 

5 

148 

843 2 

2 56 

' 2 40 

992 

957 

00315 

f ^ 

843 2 

3137 2 




Sum =-10767 

150 J 








(30 

168 64 

627 44 







5 621 

20 915 







d 








d m oms is 2 81 trom an origin of 5^ downwards 
Mean =6 25 - 2 81 = 2 44 cms 
2^3=41 83 
d(X4-d)= 37 20 
1^2 = 4 63 

Sheppard’s correction 0 08 

4 55=o-» 

<r=2 133 
or 1 067 cms. 

X« = 150x 10767 = 1615, 
n' = 12, P=013 




PAET II 

CORRELATION 

CHAPTER V 

INTEODUCTION TO COKEELATION 

A SOMEWHAT detailed account of the mathematical theory of correlation 
and of the way in which it may be usefully applied to psychological 
measurements will be found in the later chapters of this Part The object 
of the following mtroductory pages is to give the reader a general pre- 
liminary view of the method, free from mathematical complications, 
and to illustrate it by means of a simple example. 

Correlation may be briefly defined as “tendency towards concomitant 
variation,” and a so-called correlation coefficient (or, again, correlation 
ratio) IS simply a measure of such tendency, more or less adequate 
according to the circumstances of the case J. S Mill, in his “ System 
of Logic,” distinguished a special scientific “Method of Concomitant 
Variations,” which he based upon the following principle 

“Whatever phenomenon varies in any manner whenever another 
phenomenon varies in some particular manner, is either a cause or an 
effect of that phenomenon, or is connected with it through some fact 
of causation*.” 

The instances of this principle which Mill had in mind were mainly 
cases of approximately “complete” concomitance of variation, such as 
those usually met with m the domain of Physics In such cases, the 
conditions of an experiment admit of a high degree of simplification, 
the phenomenon, or series of phenomena, under investigation can be 
isolated with tolerably complete success, and the “ irrelevant ” factors can 
be reduced to a minimum Under such conditions, when the degree of 
concomitance of the different correspondmg measures of the two pheno- 
mena is found to be very high, the slight deviations from complete 

* Log%c^ Bk. m. Ck vm § 6. 


B. &T. 


7 
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correspondence are put down to ‘'errors of observation’’ or other un- 
avoidable imperfections in the experimental method employed 

If the correspondence is one of simple pioportionality, so that the 
graphical representation of it (one phenomenon being measured along 
the axis of x, the other along the axis of y) is a straight line*, the corre- 
lation coefficient r will be unity Example the variation of the length 
of a metal rod with temperature 

If the correspondence although still approximately complete, is^not 
one of simple proportionality, the graphical representation of it will be, 
not a straight line, but a curve of greater or less complexity f, and the 
correlation, also complete, will be measured not by the correlation 



Fig 15 


coefficient f, but by the correlation ratio r], which in this case will be 
unity. Example: the variation of the volume of a certain quantity of 
gas with the pressure to which it is subjected, the temperature remaining 
constant A number of pairs of values Pg, Fg; P 3 , F 3 , etc. is 

obtamed, and when plotted they are found to give a “scatter diagram” 
of the approximate form of Fig. 15. 

In this figure, the dots represent the individual pairs of observations 
P, F. They cluster very closely about the hyperbola, PF == ife, repre- 
sented by the broken curve. The curve is assumed to represent the 
“real” or “true” relation of the two “variates” (as we call such 
quantities as P, F), and the shght deviations of the observed values 

^ Hence tte correlation is said to be “linear ” 
t Correlation said to be “non-linear” or “skew.” 
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from this curve are explained as due to errors of observation and to 
other factors irrelevant to the relation under investigation However 
this may be, the interesting point about the figure so far as our present 
purpose of explaining correlation is concerned is that any definite 
observed P- value is ‘"correlated” with a plurality or “array” of observed 
F- values, and that, similarly, any definite observed F- value is correlated 
with a plurality of P-values These arrays of observed values cluster 
extremely closely about their means (situated on the cuive), i e their 
“scatter” or “variability,” as measured by their siaxidaid deviations (a), 
IS extremely small 

The modern theory of correlation is directed towards the manipula- 
tion of observations made upon phenomena of a much greater degree 
of variability than that found in the case of isolated physical phenomena. 
The increased variability is no doubt due, m the mam, to the complexity 
of factors involved The elementary factors do not admit of isolation, 
and with reference to the concomitance of variation of the two senes 
of phenomena under consideration they, as it were, pull in diSerent 
directions The correlation coefiicient and correlation ratio measure, m 
these cases, the average extent of the concomitance. As will be explained 
more fully in the next chapter, r can only be taken as a measure of corre- 
lation w^hen the average relation between the two variates is linear, and 
in this case its value is identical with that of rj When the relation is 
non-linear r is practically meaningless, but rj still measures the relation 
accurately. 

The general problem will become clearer by reference to the ac- 
companying figure. 

Let us assume that we have a group of 200 school-children and have 
measured each of them for mechanical memory (x) and for general 
intelligence (y) Each of the dots in the figure represents a child Then 
if we determine the mean j/- values corresponding to each successive 
“group” of a;- values, eg. X 2 to x^, by assuming the observations con- 
centrated on the mid-ordinate PM’*', the hne ABf drawn through these 
mean ^-values (marked by crosses in heavy type) represents the law of 
change of mean y-ralue with increase of x and gives the “most probable” 

* The true centroid ordinate is slightly nearer the denser part of the scatter diagram, 
here slightly towards the nght of PM. The correction is made later by means of Sheppard's 
formulae (see above, p 84) 

f The means have been placed on the straight line for the sake of convenience of 
exposition. Actually, they will occur irregularly on either side of it, and AB will be the 
“best fitting” straight hne, determined by an application of the Method of Least Squares 
See next chapter. 

7—2 
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value of y for any particular value of x If the line is straight or ap- 
proximately straight the ‘'regression'’ is said to be hnear, and the 
equation to the hne is 

y-y=r^{X-x), 

where x, y are the mean values of all the x's and y '3 respectively {not 
the means of the arrays ]ust mentioned), 0 * 1 , are the standard 
deviations of the x^s and y's respectively, and r is the coefficient t)f 
correlation. 



20 is the mean value of the mechanical memory of the group, 

30 „ „ „ „ general intelligence of the group, 

4 „ „ standard deviation for mechanical memory (aj), 

7 „ „ „ „ „ general mtelhgence (og), 

and, finally, *6 is the value of r; then the most probable measure of the 
general intelhgence of a child whose mechanical memory is represented 
by, say, the value 14, is given by the equation 

jr « 30 == -6 X f (14 - 20), 
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whence y — 23‘7. This value is the aveiage of an array of possible 
values, whose standard deviation 

= -r^) 

= 5 6. 

It will be proved in the next chapter that 

Na^cr, ’ 

where x and y are deviations from the mean (not absolute values as 
assumed above), and S ( ) indicates summation, i e 

S (xy) = Xiyi + + "b 

where N is the total number of cases (children measured) 

It is important to note that by starting from y instead of from x, 
and determining the means of the t^-arrays (such as the array within 
the limits y^y^i y^yz)^ another regression line, CD, is obtained different 
from the first Its equation is 

jr - 5 = r (y _ 

and it represents the law of change of mean a;- value with increase of y 
It gives the “most probable” value of x for any particular value of y 
If the series of means do not he on a straight hne (approx ) but on 
a curve of greater or less complexity, the above calculation is meaning- 
less. In such a case, called a case of skew correlation and non-linear 
regression, the only measure of the correlation of the two variates is that 
given by r}, the correlation ratio rj is the ratio of the standard deviation 
of the means of the arrays (2) to the total standard deviation (of either 
the x'b or the ^’s). Thus there are two values of tj, one for the a;’s, and 
another for the ?/’s They approximate closely to one another, as a rule, 
so that only one need be calculated. 



When the regression is linear, ri = r, otherwise t] > f r ranges 
between the values ±1,7] between 0 and 1. rj is always positive 

It wull now have become clear that the correlation ratio, r] (always) 

* First suggested by Bravais, shown to be the best measure by Professor Karl 
Pearson, who gave it the name of the “product moment” formula A. Bravais, “Analyse 
mathematique sur les probabiJites des eireurs de situation d’un point,” Acad des ScieTtces, 
Mimoires prdsentes par divers savavis, Sene, ix 1846, p 255 Karl Pearson, PBS, 
“Regression, Heredity and Panmixia,” Phtl Traiu Boy 8oc, 1896, cLXXXvn A, 
pp 253 ff. But see Pearson, Biomdi ila, 1920, xm. p 25. 
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and tke correlation coefficient, r (when regression is linear) are measures 
of the tendency towards concomitant variation exhibited by two series 
of phenomena, and hence throw some light upon the causal relations 
of these phenomena. Exactly what kind of causal relation we are justified 
in inferring from them will become clearer in the course of the next few 
chapters 

We may illustrate the significance of the idea of correlation in a 
slightly different (and more elementary) way. Let us suppose that the 
200 children have been arranged in order of merit, as regards mechanical 
memory, on the one hand, and as regards general intelligence on the 
other If now it were found that each child’s order was the same in 
both, 1 e that the child first in mechanical memory was first in general 
intelhgence, the child second m mechanical memory was second in general 
intelligence, and so on, correspondence between the two series would be 
complete and r would equal +1 Or if, on a second supposition, the child 
first in the one was last in the other, the child second in the one was 
next to last in the other, and so on, the correspondence between the two 
senes would again be complete, but inverse, and r would be — 1. Finally, 
if there is no correspondence whatever between the two series, r will 
be zero. A value of r between 0 and + 1 will express a tendency, greater 
or less according to r’s size, for children above the average or mean 
position m the one ability to be above the mean position in the other, 
and for children below the mean position in the one to be below the 
mean position m the other. A value of r between 0 and — 1 will express 
a tendency, greater or less according as r is numerically greater or less, 
for the children above the mean position in the one ability to be below 
the mean position in the other, and conversely. Wow if order or ‘‘rank‘’‘ 
be taken as an inverse measure of ability, the value of 




or r 


becomes 


6S {d?) 

N {N^ - 1) ’ 


where d is the difference between the rank of an individual in the one 


series and his rank in the other. This form gives us a general impression 
of its appropriateness for the purpose m view, since the greater the 
disparity between the two series of ranks the greater is S (d^) and hence 
the smaller is r. If there is no relation at afi between the two series, 
8 (d^) acquires the value it would have according to pure chance, and 
this can be shown to be N {N^ *- l)/6, which makes the whole expression 
zero, as it should do. 
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The one objection to the formula is that it assumes the difierence 
between any two neighbouring ranks to be equal at all parts of the 
scale This is obviously a false assumption, the distance of individual 
from individual at the two extreme ends of the scale must be con- 
siderably greater than that between individuals near the middle A 
correction for this, based on the assumption that the form of distribution 
of the abilities in each of the cases is Normal, has been calculated by 
Professor Pearson. It is 

»•= 2sin 


where 


1 ~ 


6S (#) 

N {N^ - 1) • 


At the end of this chapter is given a table whereby p- values may at 
once be converted into corresponding r-values, according to the above 
equation. 

Finally, there is the question of the probable error^’ (pe ). Like 
every other constant calculated from a limited sample of variable 
material, the coefficient of correlation varies in value from sample to 
sample, and a measure is needed of the limits within which it may be 
expected with a fair degree of probability to lie This measure is given 
by the probable error. In the case of r determmed by the product- 
moment formula, when N is sufficiently large, 


p E 


•67449 

VN 




which means that it is an even chance that the true value of r lies 
between the limits 

, -67449 (l-r2) 

VN 

The chances are 16 to 1 against the value faihng outside the limits 
r ±3 p.E. 

For r determined by the rank formula, the probable error is slightly 
larger, being *7063 (1 — r^)j^N, 

If iV, the number of cases, be small (say, less than 30), the probable 
error is larger. Its exact size under such conditions is not known 

The following is an example of the way in which a correlation 
coefficient may be obtained by means of ranks. The subjects were boys 
in the Fourth Form of a Public School, and the correlation to be obtained 
is that between ability in Classics and ability in Drawing. 
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Form Order 


R 0. 0. 

Classics 

1 

Drawing 

9 

( 1 ~ 9 )“ = 

C?* 

64 

H G M 

2 

2 


0 

B L 

9 

16 


49 

F L S 

7 

6 


1 

C.M S. 

3 

15 


144 

C J L H. 

5 

4 


1 

A L. P. 

6 

17 


121 

E G T. 

4 

3 


1 

F C E. 

8 

5 


9 

N P R. N. 

11 

14 


9 

H E D 

10 

12 


4 

S H T 

14 

7 


49 

H B. M 

12 

1 


121 

L H S 

13 

8 


25 

J P C. 

16 

10 


25 

E W. 

16 

18 


4 

COM 

17 

11 


36 

L.H W. 

18 

13 


25 

E. M. J. 

19 

19 


_0 

iV = 19 

p=l- 

6S{<P) 


6 X 688 

688=^(fZ2) 

40, 

N(N^- 


19 X 360 



= -416, 



P.E. 


•7063 (1 - r^) 

Vn 


= -134. 


r is tere just over three tunes its probable error, and we might 
therefore feel inclined to conclude that it proves a real correlation 
between the two series. We must remember, however, that 19 is a very 
small number of cases, and that therefore the real probable error is 
considerably larger than that given by the formula. Hence the reahty 
of the correlation is not so certain. Our caution is proved to be justified 
when we turn to the next higher form, the Eemove, and find that, with 
the same number of boys, the correlation between ability for Classics and 
Drawing abihty works out as — 313 (± *14), quite a different result Ib 
might be objected that other factors than mere smaUness in the number 
of cases were responsible for the difference, eg. that the tendency to 
specialise in Classics was greater in the Remove than in the Fourth, and 
that the consequent neglect of Drawing by the abler boys lowered the 
correlation. To this it may be rephed, firstly, that the drawmg-master 
was the same for both forms, and was likely to get as much out of the 
boys as possible in each case, and, secondly, that the difference between 
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the two forms in respect of the degree of specialismg tendency was in- 
sufficient to account for the disparity of the results. 

The correct way to compare the results mathematically is to deter- 
mine the prohaUe error of their difference. This = the square root of 
the sum of the squares of the probable errors of each*^, i.e. 

P.E a-b = 

which, in this case, = 

= •19. 

The difference = '416 + *313 == *73, nearly four times the size of its 
probable error = -19. 

A very important extension of the theory of correlation is the con- 
ception of “partial’’ correlation. If, eg, three mental abilities are 
correlated with one another, it is of interest to know how closely any 
two of them are correlated with one another /or a constant value of the 
third. Such a coefficient is written, in Yule’s notation, r^g.s 

This may be illustrated from our example by taking the form order 
for English into consideration in addition to that for Classics and that 
for Drawing The correlation between Classics and English works out 
as -78, that between Drawing and Enghsh, as -21. 

Then the correlation between Classics and Drawing for “English 
constant” is 


E = 


— ^CE'^DE 


\/{l — roE^)^/{l — rx)E^) 

*42 - -78 X *21 
V(l^. 782)^(1^.212) 


= * 42 . 


Thus in this particular case, the “partial” coefficient is practically 
identical with the “entire” coefficient 

If therefore boys were selected, out of a population of which 
the actual form is a random sample, so as to be all equal in their 
“English” ability, the correlation between their “Drawing” ability and 
their “Classics” abihty would be unaffected. Of course such a set of 
boys, in addition to being all alike in English, would be less scattered 
in both Classics and Drawing (especially m the former) than are the 
boys of the actual form, and their average ability in these subjects 
would be higher or lower than that of the actual form according to the 
level of ability in Enghsh at which they had been selected 

On the other hand the partial correlation of English and Drawing 

^ See p. 24. 



106 


COREELATION 


[PT 11, CH. V 


for ‘'constant Classics’’ will be found to be *-* -2, so that selection for 
Classics creates a negative correlation between English and Drawing, in 
so far as we can judge from this particular case. 

The reader must be warned agamst the temptation to draw deduc- 
tions as to the “common factors” uniting any of these pairs of subjects. 
The fallacy underlying such reasoning is discussed in pp. 139 — 145. 

The principle of partial correlation can be extended to include an 
indefinite number of variables, and general formulae for this purpose 
will be given in Chapter VII. 

It IS obvious that when the subjects in the group examined are not 
all alike in respect of some irrelevant factor such as age, these same 
formulae can be employed to ascertain what the correlations would be 
m a group which was homogeneous with regard to the factor in question. 
Great care has to be taken in interpreting the results of such calculations 
however, as fundamental assumptions may not be satisfied. This will 
become clearer in the following chapters. 



Table for converting p into r = 2 sin ^ p 


p 

r 

P 

r 

P 

r 

P 

r 

•05 

052 

30 

313 

55 

568 

80 

813 

10 

105 

*35 

364 

60 

•618 

85 

•861 

15 

157 

40 

416 

•65 

•668 

•90 

908 

20 

209 

45 

467 

•70 

717 

•95 

954 

*25 

261 

50 

518 

•75 

•765 

100 

1000 


* Quoted from K Pearson, F R S., Drapers* Company Besearch Memotrs, Biometnc 
Senes, iv 1907, p 18 



CHAPTER VI 

THE MATHEMATICAL THEORY OF CORRELATION 

Correlation coefficient r — Correlation ratio t ) — Probable errors — The noimai correla- 
tion surface and its properties — Other methods of determmmg correlation — Pourfold 
table— Method of contingency — Two-row table — Short methods — The method of 
ranks — Spearman’s foot-rule — Correlation of sums or differences — Behabihty Co- 
efficients. 

In the present chapter an attempt will be made to summarise briefly 
the principal methods in use for obtaining a measure of the correlation, 
or tendency towards concomitant variation, of two or more variates 
Let the coordinates of the dots m the accompanying diagram — 
commonly known as a ‘^scatter diagram’’ — ^represent the measures of 
two separate characteristics, e.g speed of adding figures (x) and accuracy 
of adding figures (y), m a number of individuals (iV). 



Let the crosses represent the mean values of y corresponding to 
values of x lying between the limits of pairs of successive units of measure- 
ment. Then the broken curve CC passing through these crosses repre- 
sents the most probable law of relationship between speed of adding 
and accuracy of adding, and is known as the regression curve. (In 
practice the crosses do not lie so accurately on the curve ) 

(1) CORRELATION COEFFICIENT {r) 

What we chiefly want to know, however, even when the regression, 
as here, is not linear, is (1) whether large x is on the whole associated 
with large etc , (2) how to find roughly the mean y associated with 
given X. To do this, we find the “best fitting” straight hne, LL\ to the 



108 CORRELATION [pt ii 

swarm of dots in the figure, using, merely from motives of convenience, 
the Method of Least Squares'^. 

Let the equation of LV be 

Then applying Least Squares will make S {y -- Y)^ a minimum, where 
y IS the ordinate of any dot, and Y the ordinate of the hne at the same 
abscissa, which is both X and x There will be as many equations 

(y- 7 )=^ y- (b^^x + c) = v 

as there are dots, and the correspond to the residuals” of the 
Method of Least Squares, though here they are real deviations and not 
errors The Normal Equations for Sgi formed according to the 

rule on p. 45 , give at once 

S (xy) - &21 ^ (^) = 

S{y) -hiS{x) -cS (1)^0. 

If there are N points, S (1) = N, and if the x^s and y’s are measured 
from the mean of the whole, S{x)—S (y) = 0. The equations then become 

S {xy) - 621 S (x^), 

Thus 0 IS zero, that is the hne LU goes through the mean. And b^i, 
which IS the tangent of the slope of LL\ is 

___ S {xy) ^ S (xy) 

~ S (X^) • 

The line LU is known as the regression hne, and 621 coefficient 
of regression of y on x. If we define r as 

j. Sjxy) 

Alias’ 

then &21 = ^ j 

and the equation to LU is 

Y = r^X, 

X and y being measured from their mean values. 

An analogous equation 

X = r^Y 
0’2 

gives the regression of x on y. There are thus tioo regression lines. If 

* G Udny Yule, “On the Significance of Bravais’ Formulae tor Skew Correlation,” 
Proc, Boy 80c. 1896, lx pp 477 — 489 
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X and in addition to being measured from their means, are also 
measured in terms of their standard deviations as unity, the regression 
equations become 

Z = fr and r = rZ, 

and r is then itself the coefficient of regression oi y on x and of x on y, 
the two regressions being equal. 

Since y — Y measures the distance m the y direction of any point 
from 'the regression hne, the quantity 

S{y- Yf 
N 


gives the mean square deviation, in the y direction, of all the points 
from the regression hne, 

S{y^) oz. S{^y) ^ ^ 2.S{a?) 


N 


N N 


N 


2 r ^ ^i^ 


= (1 ~ r2). 

Hence the standard error or deviation made m estimating, by means 
of the regression equation, the value of y most probably associated with 
any particular x, is, on the average, given by 


0*2 X V(1 — 

and if the distribution is Normal it has this value not only on the average 
but for each array 

T IS known as the coefficient of correlation, and evidently must he 
between the values -f- 1 and — 1. If the regression hne coincides with 
the regression curve, within the limits of errors of random sampling, — 
m other words, if the regression is linear — r is a measure of the degree 
of dependence between x and y. When r = ± 1, the points close up upon 
the Ime and the "‘scatter diagram’’ contracts to become the hne itself. 


S (xu) 

Tlie formula r = 

is implied in Bravais’ -work of 1846, and was shown by Professor Earl 
Pearson in 1896 to he the best measure of r. Hence it is known as the 
Bravais-Pearson Product-Moment Formula. It may he written 


S{xy) 

''~VS{=»^)VS{y^)’ 

the denominator being the geometrical mean of the two second moments, 
and the numerator the product-momeTit, of x and y. 
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If X and y are not measured from their means, but from some con- 
venient point distant dj from the x mean and ^3 from the y mean, the 
arithmetic is very considerably lightened, and the formula becomes, as 
may be tested by simple algebra, 

S (xy) — Nd^do 

^ - V{S (X^) - Nd^^} V{S Ih - Ndi) • 

The following example is intended to show one form of calculation 
based on this formula Being only a model for this purpose, it is kept 
short so that the arithmetic can be easily followed But %t must he made 
quite clear that really to calculate correlations with only ten cases is absurd, 
for the probable errors are enormous and moreover are unknown (see 
p. 114). A calculation with larger numbers, and made by a slightly 
difierent process, is given on p 115 seq. 

In the following table A and B are the percentage errors made by 
certain cadets in a test in judging distance, in the years 1915 and 1916 
respectively 



(2) COBRELATION RATIO {rj)* 

It is clear that if the regression is not linear r ceases to be a satis- 
factory measure of the relation between the two characters under con- 
sideration. In an extreme case, such as that shown in the accompanymg 
diagram, r may be zero while there is yet a very close relation between 
the two characters. 

Clearly, if the individual observations, i.e. the dots in the figure, are 

* See Drapers^ Company Research Memoirs, Biometnc Series, n p. 9 ei sej Karl 
Pearson, “ On the Theory of Skew-Correlation and Kon-Linear Regression *’ 
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a.11 exactly situated on the regression curve, the quantity y is an exact 
mathematical function of x, and correlation is perfect, or ^ = 1 , where 
7 ] IS a new and as yet undefined measure of correlation, called the 
correlation ratio, while if the individual observations are much scattered 
right and left of anyone walking along the regression curve, the correla- 
tion IS imperfect, and 77 < 1 

If there is no scatter at all m any array, then the correlation is 
perfect, and the greater the scatter the less the correlation, 1 e the less 
certain is any prediction of y from x. 

Professor Pearson therefore makes the correlation ratio 77 depend on the 
amount of scatter in the arrays Exactly, he makes it depend on the mean 
of the weighted squares of the standard deviations of the arrays, i.e. upon 





The correlation ratio rises and falls as this quantity falls and rises n, 
is the number of cases in the array of which is the standard deviation 
Clearly the unit in which is measured for this purpose must 
depend on the standard deviation of the whole of the y's. If the ariays 
are less scattered than the whole, there is correlation If there is no 
correlation, any array will have ]ust as much scatter as the whole has 
Pearson writes 



Compare this equation with that found above for the case of linear 

regression, p. 109, namely 

‘'average” mean square deviation of an array = 
which m our present notation is 
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and from the comparison we see that Pearson has chosen rj^ so that it 
becomes for linear regression. The correlation ratio rj however never 
becomes negative but is m linear regression numerically equal to r. 

The above formulae already allow of the calculation of r], but a 
simplification is possible. By its definition, 

- Vxflncc, 

S' being a summation up and down an array, so that 

S being a summation at right angles to the former, i e. a summation 
of the arrays That is to say, the mean of the weighted squares of the 
standard deviations of the arrays is the same thing as the mean square of 
the distances of the dots (measured in the y direction) from the regression 
curve. This simplifies to 


Na,; = SS' (yj^) - 2SS' {y,%) + SS' (y,^) 

- ^ 2S {%S' {y,)} + ;S 

= Nai - ‘2,8 iy^n^y^) + 8 

= Nai - 8 {n^y^) 

= -Rai - mi, 

where Sg is the standard deviation of the means of the arrays, each array 
being weighted with the number of cases in it. Therefore 

» 2 -_^ 2 _V 2 


<^2 


~ 2 “ ^ 2 > 
^2 CTg 


77 = 


The correlation ratio, therefore, is the ratio of two standard deviations, 
one of the means of the arrays (properly weighted), the other of the whole. 

Starting from the other variate, we arrive in a similar way at a 
second value 




_Sj 


Since 77 is the ratio of two standard deviations, it must always be positive. 

Let r be the ordinate of any point on the regression l%ne, then the 
average of the sum of the weighted squares of the distances between 
the regression line and the regression curve 

N 




which reduces to 
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Thus 77 must always be numerically greater than except in the 
case of linear regression, when it is numerically equal to r. 

In examining the relationship between two measurable characters, 
77 should be calculated as well as r, since it serves as a test of the linearity 
or non-hneanty of the regression, and is also a better measure of causal 
relation than r. 

A simple criterion for linearity which is very generally apphcable is 


that 


Vn 

•67449 ■ 


IV772 ~ r-’ < 2 - 5 ^. 


For very exact work, more comphcated formulae need to be em- 
ployed. 

The results obtained above are all %nde'pendent of the forms of dis- 
tribution of the variates. 


(3) PROBABLE ERRORS 

In determining means, standard deviations, and other frequency 
constants, the investigator is unable to woi?k from the “ total population 
and must be content with the results obtained from “random samples” 
of greater or less size taken from this (m some cases, hypothetical) total 
population 

When the number of cases {n) in the random sample is fairly large — 
so large that fractions containing certain higher powers of n m the 
denominator can be neglected — ^the probable errors are found to be as 
followsf: 

r.E of a mean = -67449 

Vn 


)) 


5 ? 59 


ff = -67449 , 

V2n 

1 — r^ 

r- •67449^^-7— . 
Vn 


The second and third of these values are only correct when the 
frequency-distribution is normal or approximately normal In parti- 
cular, for large values of r the true p.e. may be considerably different 
from that given by the above formula unless the distribution is normal. 
1^77^ 


P.E. of 77 == -67449' 




for linear regression, and also, as a rough 


* J Blakeman, Biometnha, w. pp 349, 350 

t See W Gibson, “Tables for Facilitating the Computation of Probable Errors,’* 
Biomeinha, rv. p. 385 ei seq, and Pearson’s 

B. &T. 


8 
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measure, for cases of skew correlation If greater exactitude is needed 
in the latter cases, more comphcated formulae have to be employed*. 

Another frequency constant m common use is the coefficient of 

variation F, which = — — - . 

mean 

Itsp.E. = -67449711 + 2 

As stated above, the values just given for the probable errors pnly 
apply in cases where n is fairly large In cases where n is so small that 
certain higher powers of its reciprocal cannot be neglected in comparison 
with the rest of the expressions involving them, the values cannot be 
used. For such cases no theoretical formulae have hitherto been devised. 

An empirical investigation has however been madej on samples of 
4, 8, and 30 cases, taken from a “total population'’ of 3000 pairs of 
measurements (height and left middle finger measurements of 3000 
criminals, “real” correlation, *66) From the results obtained it may 
be concluded that, although in the case of such small samples as 4 or 8 
the ordinary formula for the probable error of r gives much too low a 
value, yet in the case of as many as 30, the formula applies with tolerable 
accuracy. We must, however, bear in mind that this result has only 
been proved (empirically) to hold m the single case when the actual 
correlation was *66. 

The calculation of the probable errors of means, standard devia- 
tions, coefiSicients of variation, and coef&cients of correlation is very 
much facilitated by the use of Pearson’s Tables for Statistiaians^ es- 
pecially Tables V, VI, VII and VIII, calculated by members of the 
stafi§ of the Biometric Laboratory, University College, London. 

We give next an example of the evaluation of r and of rj between 
speed of adding single digi^s and accuracy in doing so, the individuals 
measured being 86 boys between the ages of 11 and 12 years from two 
L.C C elementary schools.’' The two groups could be thrown together 
for this purpose, since the means and standard deviations calculated 
from them separately were in very close agreement — ^well within the 
limits of the probable errors. 

♦ Karl Pearson, op. at (Biometnc Senes, n ) p 19 

t Calculated values for different values of n given in Gibson’s Tables, see pp xxii 
and 18 of Pearson’s Tables 

X “ Student” : “ Tbe Probable Error of a Coefficient of Correlation,” BvormtnhXtl^OB — 9, 
VI, p. 302. 

§ Miss Winifred Gibson, Dr Kaymond Pearl, T. Blakeman, Dr David Heron, Miss 
H Gertrude Jones, H. E. Soper. 



86 boys aged 11 — 12 years. 

Correlation between speed and accuracy in tbe addition of groups of 10 single digits. Two tests, of 5 minutes’ 
duration each. 
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Note. Tlie italics immediately beneath the frequency values within the con elation table are for the calculation of iS(xy), 

The row and colmu'rP-.^^th zeros correspond to the arbitrary means from which the true means, s d ’ s and S {xy) are calculated 
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Frequency 

x' 

Frequency 

xz' 

Frequency 

xa ;'2 

Frequency 

y' 

Frequency 

XT/' 

Frequency 

35 

-3 

10 5 

315 

6 

-55 

33 

181-5 

18 5 

-2 

37 

74 

4 

-3 

12 

36 

14 5 

-1 

14 5 

14 5 

3 

-2 

6 

12 

18 

0 

~62 

— 

9 

-1 

9 

9 

15 5 

1 

15 5 

15 5 

18 

0 

-60 

— 

10 5 

2 ' 

21 

42 

26 

1 

25 

25 

25 

3 

75 

22 5 

21 

2 

42 

84 

a 

4 

12 

48 

86 


+ 67 

347 5 

86 =^^^ 


+ 56 

CO 



+ 7 




-6 







(^1=-^= - 0-06977, 


^2 = 1 = 0-0814, 


2 248 / 7 \2 1 •<« 

= 2-7955, 

/. ai=l-67 


^ 2 _ 

347-5 . 

9 

It li 

5 

86 

4-0341, 

2-013. 

Frequencies 

xYt 

Total 

frequency/ 

j fxxY 

1+55-45-1 5 

1 

05 

+ 05 

25+05+26+3-45-5-2 

2 

1 -3 

-6 

1+06+05-1 

3 

1 

3 

2+25+05-25 

4 

25 

10 

05-1 

55 

-05 

-2-75 

1+2-1 

6 

2 

12 

0*6 

8 

0*5 

4 

i 

9 

1 

9 

3 

11 

3 

33 

-1 

22 

-1 

-22 

716-30 75 

S (xY)==40 75 


* Si^ppard’s correction Remember that and d^v^i see above, p. 84. 

t Sheppard’s correction cannot be used here, since the mats of the subgroups are 
not equaJ S<nd there is not high contact at the ends of the frequencies 
t The figures m italics m the correlation table. 
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S (xy) = S {x'y') - NdA 

= 40 75 + 86 X -0057 
= 41-24, 

S{xy) 41-24 

86 X 1 67 X 2 013 


= 0-143, 


p E = -67449 . = 0 071. 

V-Y 

■ . ^speedof addition ~ 0*14 ± 0 ‘ 07 . 

aco of addition 


Vx -y 


-0 224 

050176 X 3 5= 175616 

-1081 

1 168561 X 18 5 = 21 618379 

0 488 

•238144x14 5= 3 453088 

0 322 

103684 X IS = 1 806312 

0 145 

•021025x15 5= 325888 

0 490 

•2401 xl05= 252105 

1 719 ! 

2 954961 X 2 5= 7 387403 

-1414 

1 999396 X 3 = 5 998188 


-5 {»i(?a,-y)}*=43 345924 




s {n^ - yf} 


43-345924 
“ 86 X 4-034 
Tj = 0 353, 


= 0-1249, 


p.E = -67449 (1 - ■rf)|^/N 
= 0-064 

’lepeed ot addition ~ 0*35 ± O'OB. 
aco of addition 

Calculating rj from the means of the y-arrays, we have 


2 ^ 

7 




Ncr^^ 

19-68101 
“ 86 X 2-796 
= -0819. 

tj = 0-29 ± 0 - 07 . 

To test the value of 17 obtained from the means of the a:-arrays, for 


hnear regression 


Vn 

•67449 




•323 


2 X -07273 
= 2-22, i.e. < 2-5. 

Hence regression may be considered to be hnear. 

• See p. 113. 
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Regression coefficients: 

6j2 = r-i = -118, 

^ 2 , 

6 =r^ = -172. 

Equations to regression lines are 

X- x = \^{y - y)> 
and y -y = hi{^ — *)• 

equation to regression line AB is 

y - 164-2 = -172 {x - 237 7), 

i.e. y = -1720: + 123 316 (i). 


237 7 (mean speed) 






Fig 19 


Similarly the equation to the line CD is 

a; - 237-7 = -118 {y - 164*2), 

i.e, X = *1182/ — 218*324 .... (ii). 

Equation (i) gives the most probable value of y associated with a 
given value of cc, with a standard error 

Similarly, mutaUs mutand%s, with equation (ii). 

As model of the proper use of the correlation coefficient and ratio 
we may ^cite a very detailed investigation into the relationship of in- 
telligence to the size and shape of the head, and to other physical and 
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mental characters, by Prof. Karl Pearson*, which appeared in Bio- 
metnTca^ v. 1906 — 1907. The subjects measured were 1000 Cambridge 
undergraduates and considerably more than 5000 school-children Special 
care was taken in drawing up a quantitative scale of intelhgence, ad- 
justments being made so that the results fitted a ‘^normal'’ or Gaussian 
distribution. The correlations were worked out in several different ways, 
— correlation coefficient (r), correlation ratio {t)), coefficient of mean 
square contingencyf, and the method, first suggested in this paper, of 
the analograph, Pearson desciibes this last method as follows* “In the 
case of intelhgence, I take a normal scale as my base line and plot up 
the percentage of the character for each grade of intelhgence along the 
centroid vertical of the corresponding range, drawing a horizontal line 
to represent the mean percentage in the population at large We thus 
obtain a diagram, which I will venture to call an analograpJi 

“If the percentage increases or decreases continually with intelhgence 
(or with the base character, whatever it may be), I term the relationship 
homocUnal, if the percentage does not reach its maximum with the 
maximum or minimum of intelhgence, I term the diagram heterochnalJ^'^ 

(4) THE NORMAL CORRELATION SURFACE AND ITS PROPERTIES 

We have so far considered the correlation coefficient r from the point 
of view from which it was approached by Galton, who measured it by 
the inchnations 0^ and called the regression lines, 

according to the formulae 

r = ^ tan 0. = — tan 0o == i/(tan tan 

We followed tlus up by an application of tbe Method of Least Squares, 
first made by Mr Udny Yule, obtaining the more advantageous formula 

known as the Bravais-Pearson Product-Moment Pormula. All we have 
so far done is independent of the form of distnbution of the correlated 
variates. 

From a histoncal point of view however this is not quite the way in 
which the subject developed. In 1846 A Bravais pubhshed, in Vol ix 
of the Mimmres ie Vlnstitut de France, an article entitled “Analyse 
mathematique sur les probabihtes des erreurs de situation d’un 

* Karl Pearson; “On the Relationship o£ Intelhgence to Size and Shape oi Head, and 
to other Physical and Mental Characters,” Biomeinla, 1906 — 1907, v pp 10&— 146. 

t See below 
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point ” TMs article does not m any sense deal with the modern idea of 
correlation, though the word is casually used once on p 263. Its mathe- 
matics however is applicable to the correlation problem. 

Galton’s work was done in ignorance of this article, and of course 
was work applied directly to certain social and anthropological problems, 
whereas Bravais’ is a piece of mathematics only. Also m ignorance of 
Bravais’ work, Professor P Y. Edgeworth* took some important steps 
on the road later followed by Professor Karl Pearson, who connected 
Galton’s work with Bravais’, adopted the product-moment formula 
which was implicit in the latter’s equations, and showed that it is the 
best formula for the purpose, i e. it has the least probable errorf. 

Mr Udny Yule still later employed the simple method of arriving 
at this formula which we have used, in an article the chief importance of 
which is that it points out the fact, then first adequately realised, that 
the product-moment formula has a definite significance even if the dis- 
tribution of errors is not normal 

In the present section we shall now consider more definitely normal 
correlation. 

If the X variate is normally distributed according to the law 


and the y vanate according to the law 

1 

V(27r)a,® 

then the probability of simultaneous occurrence of a value x and a value y is 





( 1 ), 




( 2 ), 




'2 W 


dxdy 


■m, 


provided x and y are independent or nncorrelated. If however they are 
correlated, this probability is 

1 t 2rsy y^\ 

p' = ^ ~2il-r^) W ~ , 

2nay(T^ V(1 - 

which reduces to the former expression when r, the coefficient of 
correlation, becomes zero. The surface 


dxdy (4), 


z = P'jdxdy (5) 

♦ PftU Mag 1892 and 1893, several articles In a paragraph bnned in one of these, 
indeed, Professor Edgeworth reached, but did not realise the importance of, the product- 
moment formula, •which he there gives as the best formula {Phil. Mag July 1893, Senes 5, 
sxsvi on p. 100) 

t See JBiometnka, 1920, xm. p. 25, for Pearson’s views of Bravais’ work. 
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iS the normal correlation surface, and is a hillock shaped hke a bell 
with an oval mouth 

When two variates are recorded on a grid-iron table hke that used 
in the above example of Speed of Addition and Accuracy of Addition, 
the resulting table is called a “correlation table.” As, owing to the 
experimental difficulties of the subject, psychological correlation tables 
are seldom smooth enough to illustrate vividly the points about to be 
mentioned, we quote here a correlation table from the study of heredity 
which has already been used elsewhere for a similar purpose* 


Father’s Stature 


Inches 

59 

60 

61 

62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

60 





2 

2 

4 











61 





2 




4 









62 


1 

1 


2 

4 

1 

1 

2 

2 








63 

. 

1 

1 

9 

9 

s 

16 

20 

11 

5 


1 

1 




64 

4 


6 

15 

12 

17 

32 

37 

12 

5 

6 

3 

5 





65 

8 

4 

2 

8 

13 

38 

54 

43 

30 

22 

14 

10 






66 

. 

2 

4 

9 

21 

38 

40 

67 

70 

64 

21 

8 

10 

4 




67 


6 

8 

19 

14 

55 

79 

106 

103 

78 

50 

55 

13 

2 

4 



68 



6 

8 

30 

40 

41 

97 

m 

94 

Oo 

53 

34 

38 

9 



69 



4 

, 

21 

20 

51 

73 

64 

96 

116 

86 

40 

14 

9 


4 

70 





4 

10 

23 

75 

47 

78 

90 

78 

\ 58 1 

25 

14 

6 

4 

71 





— 

13 

20 

35 

43 

' 

59 

83 

1 43 

32 

20 

4 

4 

72 






1 

12 

5 

28 

31 1 

43 

45 

\ 40 

\ 

34 

11 

2 


73 







3 

3 

10 

30 

26 

24 

30 I 

1 

25 

13 

2 

2 

74 





4 


6 

6 


21 

9 

10 

26 1 

13 

13 


s 

75 










4 

8 


10 ; 

3 1 

! 7 

2 


76 










5 

1 


2 

4 i 

4 1 



77 










5 

1 

4 



6 I 



78 











4 

4 


1 

3 

1 

j 

79 



i 











i 1 

! 

1 

i 

\ 


For simplicity m printmg, the numbers m the original table in Bwme^nka, 1902—3, 
n p. 415, have been multiplied by four this eiimmatea (quarters and halves which occur 
through some heights bemg half-way between whole mches. 

♦ E g. Mr Udny Yule’s text-book on the Theory of Statistics, and, mdependently, by 
O. H. Thomson, “Mathematics and the Inductive Methods of Logic,” Proc Umv Durham 
Phil 8oc, 1912—13, V pp 76—99 
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It IS interesting to look at a correlation table in greater detail If 
we tlnnk of it as a plane horizontal surface, and erect over the centre 
of each compartment a vertical hne proportional to the number written 
in that compartment, then the tops of these hues touch the correlation 
surface. 

It IS clear from the equation to the surface that the contours, or 
hues of equal z, are elhpses, given by the equation 

2rxy ^ ^ 

£ q- ^ = constant .((5). 


In the figure the numbers 40 and over have been pnnted in italics so 
that this contour hne can be approximately followed. It is seen to be 
roughly elhptical, the major axis of the ellipse lying obhquely. The 
major axes of all the contour ellipses of a surface showing correlation 
are inchned to the axes of coordinates, and if, as we always can, we 
choose the hnear units of x and y on the diagram m such a ratio that 



Hg. 20 Fig. 21 


=: cTg, then this inchnation will be at 45®, as shown in the accompanying 
figure (Fig. 20). 

In the case of no correlation, r = 0, and if the equation (6) 

given above for the contour lines represents a circle In this case, 
therefore, with suitable umts of x and y, the contours are circles, and the 
correlation surface is a perfectly symmetrical hillock. As correlation 
increases, the contour lines become more and more drawn out along 
the 45® hne (or the 135® hne for negative correlation), as suggested 
in the figure (Fig. 21). 

In a contoured plan of a correlation surface, those lines through the 
origin are important which cross all contour hues at points where the 
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tangents to tlie contour lines are parallel to the azes of coordinates 
Such are and in Fig. 20 If we differentiate equation (6) 
with regard to x and equate to zero we shall obtain LJj^. We find 

2a: ‘iry 

or simplifying ^ — 

CTi 

Similarly the equation of is 



That IS, these are the regression lines 

We have said that any horizontal section of a normal correlation 
surface is an elhpse Any vertical section, on the other hand, is a normal 
probability curve. Consider fiist a vertical section parallel to the a;-axis. 
Write y = cm equation (4) 

After a little simple algebraical arrangement this then reduces to the 
form ! 

^ c~^V(aaV2V ^) - 

This IS a normal curve, with area 

c® 

Its centre is at a; = rcaja^, y = c, i e. on the regression line. Its 
standard deviation is independent of c 

Similar statements hold for a vertical section along a hne a? = c', 
the constant standard deviation being o-g 

A similar procedure will show, with rather more cumbrous algebra, 
that any vertical section is a probabihty curve 

(5) OTHER METHODS OF DETERMINING CORRELATION 
1. Fourfold Table. 



z. 

^2 


Vx 

a 


d -j-b 

Vn 

c 

d 

c + d 


a-hc 

d+d 

N 
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(a) Whea the divisions pass through the means of both characters, 

77 {a — b) 


r ~ sin ■ 


2 (a + 5) * 

This formula (Sheppard’s) is of httle practical use, since the mean 
values, in cases where the fourfold table is the only method which can 
be used, are generally unknown. 

(6) Yule’s coefficient of colligation* 

V ad — VSc 
's/ad + V6c 

This however is not equivalent to the correlation coefficient But if the 

divisions are not too far from the medians, is an approximation 

to r Burt has used it for Binet test elements where nothing but a twofold 
division IS provided forf. 

Taking the correlation table on p 121, for which product-moment 
r = 0*51, various divisions may be tried. Taking 67| inches for fathers 
and 68| inches for sons (which approximate to the medians) we get 


1425 

729 

581 

1577 


giving CD = 0*394, 

The probable error of o is 


sin = 0*58. 


0 67449 ( 1+1 




J)- 


(c) Tetrachoric r. The correct value m such cases, provided a normal 
surface is assumed to underlie the fourfold table, is given with greatest 
probability by tetrachoric r. Let a be the quadrant m which the means 
he, and write = 6 -i- d, = c + d, then t is obtained from 
djN == TqTq 4- 'T'lTi'r + 

The values of ... corresponding to various values of are given 
in Eventt’s Tables of Tetrachoric Functions, Biormtnha, vii p. 437, or 
Table XXIX in Pearson’s Tables, where examples are given It is only 
occasionally needful to go beyond Tg. 

* Yule, J ourn. Boy Stai, Soc 1912, lxxv p 592 
t MenUd and Scholastic Tests, London, 1921, p 217 


Figure 22 omitted m this edition, cf. p. 92. 
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The probable error of r obtained by the fourfold table method is 
much larger than that given by the formula of p 113. The correct 
formula is too complicated to insert here*. 

2 Method of CoNTnsTGENCYf 

The following is an example of a contingency table:]* 


Fathers 


- 

Merry 

Melancholy 

Altematmg 

Even 

Totals 

Merry 

122 

8 

81 

67 

278 

Melancholy 

10 

2 

7 

10 

29 

Altematmg 

70 

9 

101 

68 

248 

Even 

58 

6 

66 

46 

175 

Totals ... 

260 

25 

255 

190 

730 


Arithmetically the method is as follows Divide the square of each 
of the above numbers by the product of the totals of its row and column. 
Thus for example 


This gives the table * 

122® (278 X 260) = -2056. 

2056 

0092 

0926 -0849 

0131 

0055 

0066 ‘0179 

0760 

•0130 

1614 -1010 

0739 

0082 

0976 0609 


The grand total of these fractions is 1*0274 and the coefficient of mean 
square contingency Ci is 

V 1-0274 

The method is employed when the grouping is merely by class and 
the different classes have no known relation to one another — m other 
words, when the grouping is merely qualitative. The order of the 
different quahties can be changed without making any difference to 
this method 

♦ Unless the dichotomies are extreme, good values are obtained from the use of 
Tables XXIII and XXIV, Pearson’s Tables 

f Karl Pearson, “ On the Theory of Contingency and its Relation to Association and 
Kormal Correlation,’’ Drapers' Company Research Memoirs, Biometric Series, i, 1904, 
Dulau and Co , London. 

J Taken from a paper by E. Schuster and E M Elderton on “The Inhentance of 
Psychical Characters (being a further Statistical Treatment of Material Collected and 
Analysed by Messrs G. Heymans and E. Wiersma),” Biomeinha, 1906 — 1907, V. pp. 
460—469, 
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The relationship between the two variables is measured by the 
difierences between the numbers actually found in the various com- 
partments of the table, and the numbers that might be expected there 
by pure chance 

To state the rule : 

The total mean square contingency, of the table is given by 






N 


where = total frequency in ^th row, 

= total frequency m qth. column, 

= frequency of constituent common to _pth row and gth column, 
N = total number of cases m the table. 


Then the coefficient of mean square contingency is : 





_i!_. 


If it is assumed that a normal distribution underlies the classification, 
and if the fineness of grouping is right, then the coefficient Ci is nu- 
merically equal to the correlation coefficient r. 

In the above case, = 0*16. 

The probable error of is very comphcatedf , It may be taken as 
approximately one and a third that of r. 

Instead of calculating the mean square contmgency, it is easier though 
not so accurate to calculate the mean contingency. Each quantity 




N 


* There are certain corrections to <p\ not mentioned here, which often make con- 
siderable difference to the result See K Pearson, F R S , “On the Influence of Broad 
Categories on Correlation,” Biometnlca, 1913, ix. pp 116 — 139 The important pomt is to 
have fine enough groupmg, but not so fine as to leave cells with very few or no cases hi 
them If there are k columns and X rows the assumption of a rectangular distnbution 
(an unlikely assumption) leads to the corrective factor 


\/ (K- 


k\ 


{K-l) (X~l) 


by which Ci has to be multiphed. This correction is undoubtedly too large, and empirically 
the fourth (instead of the second) square root in the above factor gives better results 
t J, Blakeman and Karl Pearson, “On the Probable Error of Mean Square Contm- 
genoy,” B%(metnha, 1906, v. pp 191 — 197 A W. Young and Karl Pearson, “On the 
Probable Error of a Coefficient of Contingency without Approximations,” Biometnka^ 
1916, XI pp 215 — 230. 
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IS called a subcontingency, and it will be observed that m the formula 
for these were squared. Instead of this, let us, without squaring 
them, add the ‘positive subcontingencies only (for of course the sum of 
the whole is zero), and write 

From \jj, by using Table XXXIV of Pearson’s Tables, a value of 
the*second coefficient of contingency is read off, which, under condi- 
tions similar to those outhned above, also is equivalent to r. 

The contingency method, it must again be emphasised, gives these 
two measures of the connection or association of the qualities considered 
even without any assumption that a continuous variation underhes 
the discrete classification. If however such is assumed, then the approach 
to equahty of Ci and Og ^ good measure of the normahty of the 

distribution and the suitability as to smallness of our elements of 
grouping With very fine grouping we get into difficulties owing to having 
to record by units only 16 to 25 subgroups is a good range 

It IS interesting to find that areas of positive contingency are sepa- 
rated from areas of negative contingency on a normal surface by a 
hyperbola having a simple relationship with the contour elhpses. 

3. Two-row Table=^ (Biserial r). 

This method gives a unique value of r in the case of two variates 
one of which is both quantitative and continuous (eg intelhgence), 
while the other, though quantitative, admits of only two subdivisions 
(e g. into good and bad visuahsers), or, in more technical language, is 
alternative.” 



♦ Karl Pearson, F.E S , 1909, vn. p. 97, 
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The assumptions made are two in number: 

(1) that the regression IS 

(2) that the distribution of the alternative variate is approxi- 
mately normal or Gaussian. 

The regression hne x y 

Oi <72 

must go through the centroids of the good visualisers and the bad 
visualisers The abscissae x* and x" of these centroids can be found 
from the data They are the mean inteUigence of the good visualisers 
and the mean intelligence of the bad visualisers respectively, measured 
from the total mean. The ordinates y' and y'' of the two centroids can 
be foimd from page 38. If there are pN good visuahsers and qN bad 
visuahsers then by that page 

pNy' = (72^Z, 

where Z is the ordinate of a normal curve divided into the areas fN and 
qN by Z, and havmg sigma equal to cjg. Or 

fy' = 

where z is the corresponding ordmate of a normal curve of unit area and 
umt sigma given in Sheppard’s Table (Table II of Pearson’s Tables, the 
z corresponding to (1 + «) of that table). 

Similarly qy'" = 

We have therefore x' y' jr" ^ 

0*1 02 (Ji <72 

•• (7i <72 \p qj pq pq* 

x' -f- x'" IS the distance between the centroids (smce they are on oppo- 
site sides of the general mean from which x is measured) and therefore 
can be replaced by m' — m", where m' and m" are the means (measured 
from the ordinary zero) of the intelligence of good and bad visuahsers- 

Therefore m' — m" VQ 

r = — . 

Ol ^ 

Herein m' is the mean of the one class of whom there are pN cases, 
m" the mean of the other class, z is the ordinate m Sheppard’s Tables 
corresponding to J (1 4- cc) of those tables, is the sigma of the 
contmuous vanate. The probable error of bisenal r is approximately 

0 . 67465 ®^’. 


Figure 23 omitted in this edition, of. p. 92. 
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In cases where the rc-variate (continuous and quantitative in our 
example above) can only be divided into classes, showing no definite 
order or quantitative relations to one another, the ^-variate being again 
quantitative and assumed to follow a normal distribution, but alter- 
native, a modification of the above method gives 

4. Short Methods’^. 

(i) It can easily be shown that 

and therefore that , 

This formula has been ingemously utilised by Toopsf and by Otis 
to minimise the arithmetical work of product- moment r In a correlation 
table like that on p 121, and Gy are of course obtained from the 
marginal totals of the rows and columns respectively. In identical 
manner G^^y can be obtained from the diagonal sums from low-low to 
high-high Along any such diagonal the difference between father's and 
son’s stature is constant These authors have pubhshedj blank forms 
which direct the calculation and reduce errors to a minimum 

(u) If the distributions are both normal, and if both variates have 
the same mean, and the same standard deviation ct, then 

7r{S{x--y)f 

xW 

where S is the sum of the positive differences only This method might 
sometimes be con vemently used in determining the ‘‘individual” corre- 
lation between performances of the same mdividuals in the same mental 
tests on different occasions 

5. The Method op Ranks* 

Some years ago the valuable suggestion was made by Professor 
C Spearman § that measurements of psychical performance may con- 

Karl Pearson, “ On Further Methods of Determining Correlation,” Drapers' CompaTiy 
Research Memoirs^ Biometric Senes, iv 1907 

f Journ Exp Psychol, 1921, 3CV p 434 

% Toops, Teachers’ College, Columbia Umv., New York Otis, World Book Co , Yon- 
kers, N Y. 

§ C Spearman, “Measurement of Association between Two Things,” Am Journ 
Psychd, 1904, xv , “‘Foot-rule’ for Measuring Correlation,” Bnt Journ of Psychology, n 
Pt. I, July 1906 Were it possible to keep B m its place merely as a “foot rule” whose 
“chief mission is to gam quickly an approximate valuation of r,” it would not be haimful 
But the ease of its calculation leads to its use too frequently “not merely for assay purposes 
as originally contemplated, but even sometimes for research” (see G. Spearman, Bnt 
Journ, of Psychol 1910, HI p 286). 

B. &;T. 


9 
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veniently — nay, preferably — be replaced by tbe numbers representing tbe 
rank or order of merit of tbe indmduals m tbe group On tbis basis 

tbe ordinary product-moment formula for r, ^ , can be easily shown 


to reduce to tbe form 


p- 1 


Nc 

N {N^ - 1) 




where and are tbe ranks of an individual in tbe two senes. 

Professor Spearman also suggested a still simpler formula, wbicb be 
calls a ‘"foot-rule” formula. It is 


iS- 1- 


S{g) 


.... (i3), 


where S (g) denotes tbe sum of tbe “gams” m rank (sum of positive 
difierences) of tbe second series on tbe first, and then empirically, by 
noting the distribution of a large number of chance values of S (g)^ 

r = ... (y). 


This method of using ranks, and the formulae suggested therefor, 
were vigorously criticised by Karl Pearson in tbe paper quoted on tbe 
preceding page*. 

Some form of frequency distribution must be assumed, and tbe 
“foot-rule ” method assumes that form to be a rectangle On tbe assump- 
tion of normal distribution, Professor Pearson shows that 

r = 2sm(^pj (S), 

where p has tbe value given above 

In terms of tbe sum of 'positive difierences of ranks (“gains” m rank) 
tbe formula is 

r = 2cos27r|^;^^}-l 

= 2cos 5(1-S)- 1 (e). 

6 


This agrees very closely with Spearman’s formula (y), and, having 
a definite theoretical basis, should now take its place. 


(6) CORRELATION OP SUMS OR DIFFERENCES f 
This article is concerned with tbe following problem. After calcu- 
lating tbe correlations between several series of values, it frequently 

* Professor Spearman endeaTonrs to meet some of tiiese oritioisms xn Bnt Journ. 
of Psychol, 1910, m. p 271 «grgr. 

t 0. Spearman, Bnt, Journ of Psychol 1913, v. p. 417. 
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happens that we want the correlations given by some of the series added 
together, and diSerences are not less important than sums. The corre- 
lation of the pool IS not the mean of the correlations. The general problem 
IS as follows 

Let the two series of values be denoted by and 

hi,h 2 each being measured from its own mean and consisting of 
N cases Let these variates be multiplied by constants or weights. 
Required the correlation between 

A = -I- 4- ... + 

and B = 4 

Since all the a’s and Vs are measured from their means, it is clear that 
A and B are also so measured. The required correlation is therefore 

S^{AB) 

where the symbol S' indicates summation from 1 to We shall retain 
the symbol S, on the other hand, for summation from 1 to p or 1 to q. 

Consider now the correlation of any particular a with any particular b 
It is given by 

= S' {ah). 

Multiplying the a by its constant n, and the h by its constant m, only 
alters the standard deviations of these quantities, not their means, 
smce they are already measured from means We have therefore 

== S' {na,mh), 

and summing this over the p and q measurements of a and h we get 
NS {nmoaGi^ra^) = SS' (na,mh), 

Now the right-hand side of this equation means the sum of all pos- 
sible products of na and mb. But a little consideration will show that 
this is exactly what the numerator of r, viz. S' {AB), means. Therefore 

S' (AB) = NS {mm^a.r^,). 

The two quantities in the denominator of r are found similarly, or by 
putting A = B in the expression just arrived at, and we have finally 

_ S 

~ V{S S ’ 

wherein the summations in the denominator include the correlations of 
an a or of a 6 with itself, correlations which of course are unity and each 

9 — 2i 
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case like has a twin case ata^. If all the o-’s are equalised, if all the 
n’s and m’s are unity, and there are 'p a’s and q 6’s, this becomes*** 



V{p + 2S(r,,)}V{? + 25 (.,,)}• 

(7) Reliability Coefficients. 

Anyone who has carried out psychological experiments, or even an 
ordinary examination, on the same subjects with similar tests on two or 
more different occasions does not need to be reminded that the results 
will differ, sometimes very decidedly. Unless however the differences are 
only slight, it is clear that the test or examination is of no practical use. 
Its reliability can be conveniently measured by the correlation coefficient 
of the marks obtained on the two different occasions Such a correlation 
coefficient is called a reliability coefficient In practice tests which give 
reliability coefficients lower than 0 7 are almost useless, and the ideal 
would be a great deal higher than this 

In the case where we have two forms of a test correlating with one 
another and we wish to know how well a similar test p times as long 
would correlate with one g times as long, then with the assumptions 
mvolved in making m the above formula ail r’s == all a’s = a^ and all 
= all m’s = unity, we obtain 

pqr-i 

“ ^/{p + - jj) j-jJ V{g- + (g2 _ q) rj}* 

For p — q this gives the reliabihty to be expected if a test is made p times 
longer, being the present reliability, viz. 

Wi 

l + {p^l)T^> 

sometimes called William Brown’s Formula f. If is the correlation of 


* Several convement forms of tlus are given by Wynn Jones, Brit Journ* of Psychol. 
1924, sv p 20 

t Proved independently by Spearman and by WiUiam Brown on pp 290 and 299 
respectively of Bnt Journ of Psychol 1910, m. Pt 3. William Brown’s simple proof from 
first prmciples is as follows* “If ccj, Og? V pairs of results {x denotmg deviation 

from the mean value), we may assume that 

<^Xi~ = CTx^' — (Tx/ = Cx 


and that 
Hence we get 


fS {x^Xi } — B ^ ^ ^ 

fg — 

71 (Txi+Xz ^Xi 

__ 4:71 (Tx^r^ 

7h {2(rx*+2rj_ffx^) 
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the two halves of a split test, then for ^ = 2 the last formula gives the 
reliabihty of the complete test. The assumptions made do not always 
hold, as Holzinger"^ has shown empirically. 


It IS easily seen that the amalgamation of four tests gives a reliability coefficient 


and, m general, for p tests we have 

P^i 


1 -j- ’ 


This last formula furnishes a ready means of detennmmg from the reliability coefficient 
of a smgle test, the number of applications of the test which would be necessary to give 
an amalgamated result of any desired degree of rehability ” 

Jouin of E due, Psychol 1923, xiv p 302 See also Crum, Amer Math Monthly, 
1923, ssx p. 296 and a reply by Kelley, Jowm. o/iJdiiC Psychol 1924, xv p 193 
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THE INFLUENCE OF SELECTION 

Influence of mild selection on cr and t — ^Rigorous selection and partial correlation — 
Three correlated vanables represented by dice throws — ^Multiple correlation — 
Spurious correlation — ^Vanate difference correlation method. 

(1) THE INFLUENCE OF MILD SELECTION 

The essential point about the whole theory of correlation is that it tells 
us how a group of individuals selected from the general population 
according to some characteristic (say as being within certain hmits of 
height, or possessing some mental abihty or manual dexterity in a high 
degree) will also diSer from the general population in other charac- 
teristics 

The ordinary correlation coeflacient already tells us much in this 
respect For example, if the correlation between two abihties, say 
(1) the abihty, whatever it may be, which is measured by Dr McDougall’s 
Dotting Machine and (2) the ability to memorise Nonsense Syllables 
according to certain experimental regulations, be known to be *4 for 
the whole population, this means that if a group be selected with 
‘‘Dotting” abihty equal to x (measured from the general mean in 
a units) then this group will most probably have an average “Nonsense 
Syllable” ability equal to *40? (measured in a similar way). 

Clearly in practice we do not usually know the means and the 
correlation for the whole population but only for samples. We take 
large samples and endeavour to ensure that they are random and not 
selected samples from the population we wish to mvestigate. 

The selection contemplated in the above example is very rigorous: 
all the individuals are presumed ahke in regard to “Dotting” abihty. 
In practice such a rigorous selection never takes place. The boys in 
a school form, for instance, are more alike in say abihty m Latin than 
the general population, yet not absolutely ahke. The “scatter” of this 
vanate (Latin) has been reduced, yet not to zero. 

Just as selecting a group of mdividuals for one variate will alter 
the average value of other variates, so it wiE alter the scatter of these 
other variates, and their intercorrelations. It is this phenomenon which 



PT. II, OH. vn] THE INFLUENCE OF SELECTION 


135 


m an extreme form gives ns wLat we already know as ‘^partial corre- 
lation” (seep 105). 

In fact, selecting a group of individuals witkm certain limits of a 
quality A implies an indirect and less rigorous but frequently very 
important selection of the other quahties 5, C, . of these individuals 
and of their mtercorrelations Consider the simplest case of three organs, 
A being directly, B and 0 only indirectly selected. Let subscripts 1, 2 
and 3 refer to A, B and C respectively, and let the standard deviations 
and correlations in the general population be Oj, o-g, erg, rgg and fgj 
In the selected group is reduced by the selection to and o-g and Og 
are indirectly altered to Sg and Sg, r^g, fgg, to Tjg, Pgg, Then the 
following formulae enable these quantities to be calculated*. 

Write sJgi — cos xi 

Then Sg/erg = sin a^g, and Eg/ag = sin a^g, 

where cos == r^g sin Xn ^ind cos ajg == r^g sm xv 

Further ri 2 == cot xi cot ajg, 

^13 ~ Xl %35 

fgg — cos ^12 cos Ujg 
roa — ' • 

sm a^g sm 

For example let us suppose for the moment that the correlations 
between (1) Classics, (2) Drawing, and (3) English have, m the general 
population of Enghsh Fourth Form boys, the values found on pp 104 
and 105, viz. 

r^g = *42, 

^*23 == 

and let us further suppose that, say on a standardised percentage system 
of marking, the standard deviations of the marks m these subjects are 

Gi = 16 , 

CTg == 13, 

ag-14. 

Now suppose a mild selection of Fourth^ Form boys to be made on 
the basis of their ability in Classics, and m the selected group let us 
suppose that the standard deviation m marks m Classics is reduced 

- 12 . 

* See Karl Pearson, F R S , “On the Influence of Natural Selection on the VaisaMhty 
and Correlation of Organs,'’ Ph%l Trans, 1902, CO. A, pp. 1 — 66, where an mterpietation 
in terms of sphencal tngonometjy is given. 
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On substituting these values in the above formulae we obtain the follow- 
ing tables; 

Standard Deviations 



Before 

3Miid selection 

Rigorous selection 


selection 

m Classics 

in Classics* 

Classics 

16 

12 

0 

Drawing 

13 

12 5 

118 

English 

14 

12 

87 


Correlations 

Before Mild selection Vigorous selection 

selection m Classics m Classics* 

Classics and Drawing *42 *33 — 

Classics and English *78 *68 — 

Drawing and English 21 *08 -*21 


This mild selection for Classics has therefore left the scatter of ability 
m Drawing almost untouched, but has made the group somewhat more 
homogeneous than it was in Enghsh The mtercorrelations are all 
slightly reduced, that between Drawing and English bemg now almost 
ml 

These formulae show the result on ^is ^ change m homo- 

geneity made by reducmg Ci, They also show the effect on r^^ of reducmg 
oTi, where the quantity (1) does not enter directly into the correlation. 
If m this last case the quantities (2) and (3) are equally correlated with 
(1) then we can in the above formulae write and we find 


whence 


1 ^23 ^2^ ^3^ 


In words, when there is a change in homogeneity, unity minus the 
correlation coefficient is inversely proportional to the variance (a term 
suggested by Student, in Biometriha, 1923, for the square of sigma) 
This equation has been independently reached by Otisf for the purpose 
of correcting correlation coefficients measured in a group with narrow 
range, and by KelleyJ for the special case of reliability coefficients It 
is only strictly applicable if the narrower range of the group has been 
produced by selection in a trait (1) which is (at least approximately) 
equally correlated with the two quantities (2) and (3) whose correlation 
is to be corrected: not if (2) or (3) have been directly selected for. 


* See later. 

t Journ Educ Psychol May 1922, p 293 
i Journ. Educ Mesearch, 1921, m. p 377. 



CH. VIl] 


THE INFLUENCE OF SELECTION 


137 


(2) RIGOEOUS SELECTION AND PARTIAL CORRELATION 
If we suppose the selection in Classics to be absolutely rigorous, so 
that the resulting group is absolutely homogeneous in abihty in that 
subject, then our formulae simplify considerably and we are left with 

Si = 0, 

Xi = 90% 
sinxi= 1, 


cos = ri 2 . 


COS aj3 — rj3, 

23=0'3V(1->'i3^), 

is meamngless, the variate 1 being and similarly r^^g; 


^ _ ^23 ^12^13 


^20 1* 


This formula was reached by Pearson and Yule* before more general 
formulae were known, and is called the “partiaF’ correlation of variates 
2 and 3 for a constant value of 1, and is written j. Mr Yule obtained 
its value by applying to three variables the methods we have already, 
following him, employed on p. 108 foe two, using the Method of Least 
Squares. 

The p e. of a partial correlation coefficient is similar in form to that 
of a total correlation except that for the number of cases n we write 
n — s, where s is the number of variates ehminatedf, i e. 


0*67449 


1- r2 
\/{n — s) ’ 


For the first partial correlation coefficient here discussed, s = 1 and 

PE of rgg 1 = 0-67449 . 

^ ^ ■\/{n — 1) 

Tables for calculating partial correlation have been given by Kelleyf, 
and graphic methods by Kelley § and by E. R Woody 

If we apply “partial” formulae to our three variables (1) Classics, 


* K Pearson, Proc Roy Soc 1895, LVin p. 241 (partial regression coefficients), and 
O. Udny Yule, “ On the Significance of Bravais’ Pormulae for Skew Correlation,” ibid 
1896, LX pp 477^89 

t R. A Pisher, 3Ieiron, 1924, rti p. 320, and see Yule, Proc Roy. Soc. 1907, Lxxix. 

p. 182 

t BnUetm of the Univ of TexaSt May 10, 1916, No 27, 

§ StcAistical Method, New York, 1923, p 291. 
i| State Hormal School, Emporia, Kansas 
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(2) Drawing, and (3) English., we shall get the standard deviations and 
correlations for a rigorous selection in Classics, given in the third column 
of the above tables. We see that the group is still heterogeneous in 
Drawing, but a good deal more homogeneous in English. The correla- 
tion between Drawing and English has now actually been reversed. 
Needless to say, the actual numbers in this example are not to be taken 
as giving the facts, being only used for the sake of illustrating the method 

It IS important to realise, and becomes clear from the above con- 
siderations, that all correlations are partial correlations, inasmuch as 
there is always a selection of the group we are working with, for age, 
or race, or social standing, or what not. Indeed even the whole living 
population is only a group, surviving from ‘‘what might have been,” 
by natural selection. This wide point of view will save us from many 
of the errors into which we are apt to fall in handling correlation 
coefficients. 

It IS particulaily tempting to draw what are usually fallacious con- 
clusions from the comparison of “entire” and “partial” correlations 
as to the underlying factors at work causing the correlations For 
instance, in the present case one might be tempted to conclude that the 
original positive correlation between English and Drawing was entirely 
due to factors which these share with Classics, that is, to a general 
factor, and that any direct connection of these two subjects is of an 
“inteiference” nature. But such conclusions as to the underljing 
mechamsm have to be made, if at all, with great reserve, as will be seen 
from examinmg cases where we have independent and first-hand know- 
ledge of the factors at work, as we have for example in dice throwing 
A correlation can be set up between two dice throws of m and n dice 
respectively by leaving some of the m dice lying to form part of the 
second throw. 

(3) THREE CORRELATED VARIABLES REPRESENTED BY 
DICE THROWS* 

Let n red dice, n blue, n yeUow, and n white dice be thrown, and let 
the variable x be given by the combined red and white, y by the com- 
bined yellow and white, and by the combined blue and white scores, 
as in Fig. 24. 

That is to say, there is a general factor (the white dice), common 

* This section is an extract from an article by Godfrey H Thomson, Bnt Journ, 
of Psychol 1919, ix p. 323 ei seq Dice throws were used to illustrate a simple case of 
coiTelation by Weldon m Lectures on the Method of Science, Clarendon Press, 1906, p. 100 
Brown m the first edition (1911) of this book, p 79, proves Weldon’s formula theoretically. 
Thomson’s proof of the more general formula on p 141 hereof was an extension of Brown’s. 
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to all three variables, wMcb causes all the correlations between them 
These correlations are 

^xv ~ ~ ^ a* 

Red 

n 

A 


X 



Fig. 24 



Fig. 25 

The partial correlations are, by the well-known formula, 

= **« V = (-1 - i • 1)/V(1 - (iP) (1 - (if) = i 

It is not permissible, however, to reverse this statement, and to assume 
that in every case where = faa. = | the correlations are formed 
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solely by the action of a general factor. In fact, identically the same 
values can be produced without any general factor at all Let n purple, 
n green, and n orange coloured dice be thrown, and let the variable x 
consist of the purple and orange, y of the orange and green, and 2 ; of the 
green and purple scores combined, as m Fig. 25. 

Here there is no general factor whatever. The connection of x with y 
(through the orange dice) is entirely independent of the connection of x 
with ^ (through the purple dice). 

Yet the correlations, both partial and entire, are exactly the same as 
in the first arrangement, viz. 

^ ^yz ^ ~ j 

^x/y z ~ ‘^yz X ^ y ^ Z * 

Clearly, therefore, if we only know of three variables x, y, and 2 :, 
formed of dice throws, that their correlations are as above, we cannot 
say with certainty whether a general factor exists or not. Let us now 
consider a more general arrangement of dice, with numbers of difierent 
colours, viz. W white, R red, B blue, Y yellow, P purple, G green, 
and 0 orange, thus: 

X 



X consisting of the scores of the TF, P, P, 0; ^ of the IF, Y, 0, G, and 
z of the IF, P, G, P dice. 

In this arrangement we shall call IF a general factor^ it being common 
to all three variables, P, Y, and B specific factors^ they being umque to 
X, y and z respectively, and 0, G and P group factors, since each runs 
through a group of (here two) variables. 
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The theoretical values of the correlation between any two of the 
variables, say x and y, can be found by means of the formula* 

Number of dice common to x and y 

^ ~ ZS- 

^ Geometrical mean of total dice in x and m y ’ 

For example, if x is the score of 9n dice, and y the score of in dice, 
2n being common, the correlation is 


2n 

's/^nx in 


?-033 


The general arrangement of dice shovm in the above figure includes the 
two special cases already considered, viz 

(1) p =. e = 0 = zero, P = P = r = 7/ = /i, 
and (2) P G = 0 = n, p = P=:r=Tf== zero; 

which both give r^y = 

Of the infinite arrangements possible with this diagram, an infinite 
number (of a lower order) can in general be constructed to pioduce any 
given set of positive correlations between a;, y and zj. Moreover, all 
these possible ways of producing the reqiured correlations are, m our 
Ignorance, equally hkely to have been those used by the person making 
the arrangement of dice, although they are, it is true, not equally 
probable as chance occurrences. From the correlations, therefore, we 
cannot in general deduce what proportion the white dice (i.e the par- 
ticular colour representing the general factor) bears to the others, for 
this proportion can vary between wide limits, and give exactly the same 
correlations. The most we could conceivably do would be to give the 


* This fonnula was proved by me in Jonm of Psychol 1916, vm p. 275, m ignorance 

of any former statement of it. Professor Spearman showed {ib%d, p 282) that it is deducible 
from a formula of his concemmg correlation of sums or differences. I have since noticed 
that Professor Spearman gives the followmg clear expression of the formula (Ant. J ourn. of 
Psychol 1904, XV p 75): “The correlation is always the geometrical mean between the two 
shares.” I do not however agree with the apphcation he there proceeds to make The 
formula can also be directly deduced from Btavais, and in several other ways. It assumes 
that the elements all have the same standard deviation, as dice have. G H.T 

*1' If he be so minded, the reader can make thousands of other dice patterns, all giving 
the correlations g^o^P ^ given by 

= P==Q:=:^O^sn. 

But such a high degree of symmetiy is unnecessary. For example, another pattern giving 
the same correlations is 

iJ=91w, y=91?i, B=54?i, P=78n, G=78a, 0~91n, lf=78a. 

The number of whit© dice present ranges between the two extreme cases given m the text. 

if A convenient method of finding such arrangements or patterns to give specified 
values of the correlation coefficients is explained by J, Eidiey Thompon, Br%t. Joum. 
of Psychol 1919, x. p. 98. 
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‘'expectation’’ of the proportion of white dice. The meaning of this 
would he, that if a very large number of arrangements of dice were 
examined, each giving the required set of correlation coejBB-Cients, and 
we assume that these arrangements of dice are not formed on any plan, 
beyond that they all agree in the correlations they produce, then the 
average proportion of white dice would be that named as the “ expec- 
tation ” thereof But if there is any reason to think that the large number 
of cases examined are all of much the same pattern — as there would be 
were they all natural phenomena of the same sort — then the expecta- 
tion ” of the proportion of white dice becomes useless and meaningless. 
We cannot conclude anything which is of any definite value in con- 
structing the pattern, except give hmits within which it must he. 

This brings us to the problem — ^Are there any values of r^y, ry,, and 
which make it certain (having regard to their probable errors) that 
at any rate some general factor, some number of white dice, exists? The 
answer is that this is so if the correlations are large enough. For example, 
if we take the special case of equahty of the three coefficients, 

~ ~ ^zx ~ ^9 

then up to r == -I the correlations can be imitated by various numbers of 
red, blue, yellow, purple, green and orange dice without any white dice. 
But as soon as the common value r rises above some white dice are 
necessary. In this case therefore the proof of the existence of (at any 
rate) some amount of general factor reduces to the examination of the 
probable error of r, to see if r is indisputably greater than 

In the more general case the matter is not so simple, the three values 
of r differing from one another. The more detailed examination of this 
case IS reserved for treatment elsewhere. It will be found however that 
if the quantity 

“b "b '^zx‘ “b '^^xy^yz^zx 

is indisputably greater than unity, then some white dice, some general 
factor, may be postulated with certainty*. It may not be out of place 
to remind ourselves again that this, though true of the arrangements of 
dice we are considering, may not be true in the same sense of other 
phenomena, e.g. biological or mental phenomena. 

The following two examples illustrate the above principles. 

* A rough, guide is the average value of the three r’s: if this is greater than J some 
general factor certainly exists. The exact condition however is that given m the text. 
It IS due, m this form, to Mr J. E». Thomp'ton, see Br%i, Joum of Psychol* 1919, ix. p 335 
Note that ah this only apphes to correlations produced by overlapping dice throws, or by 
some suffiiciently similar mechanism. 
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Example A 

Three variables, composed of overlapping dice throws, give corre- 
lations as follow* 

?*^j, = 0 32, n^;5==0-33, 

Are any dice common to the three variables^ 

In this case we find 

-1- + ^zx + = 0 56, 1 e. < 1 

From this we conclude that these correlations can be imitated either 
with or without a general factor of white dice The following arrange- 
ments of dice do actually produce these correlations 

Case (1) i? = 19^, B = 17n, Y = 85w, (specific factors), 

P G 0 = zero, (no group factors), 

Tf == 21^^, (a general factor). 

Case (2) R = 15?^, B = 16n, Y = 16w, (specific factors), 

P = 4t7n, G = 25n, 0 == 24w, (group factors), 

TF = zero, (no general factor). 

Example B 

Three variables, composed of overlapping dice throws, give corre- 
lations as follow. 

r,,-0'72, r^,-0-77, r,, = 0 67. 

Are any dice common to the three vanables^ 

In this case we have 

1 6 > L 

We conclude therefore that some white dice common to the three 
variables are present, i.e that there is a general factor. The follovfing 
arrangements of dice do actually produce these correlations, the general 
factor being a minimum m one and a maximum m the other 

Case (1), R == 156?^, B == 104^, Y == 52i2, (specific factors), 

p ^ G ^ 0 — zero, (no group factors), 

W = 260?2, (general factor). 

Case (2). JS = J5 = F == zero, (no specific factors), 

P — 90?2-, G = 16bi, 0 ~ 123n, (group factors), 

If — 198/^, (general factor). 

We see then that if 

“h 4“ 4" '^^xy^yz^zx ^ 

the presence of some white dice is certain. If the above quantity, which 
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we shall call D, is equal to or less than unity, the presence of white dice 
IS uncertain. Suppose we consider two cases in which 

Txy = 0-8, = 0*4, r.a, = O'l, i) = 0*842, 

and r^y = 0 2, Ty^ = 0*2, = 0*1, 2) = 0*094, respectively. 

Can we in these two cases say anything as to the prohahhty of the 
existence of some general factor^ 

The answer to this question is twofold. If we suppose that the person 
making the arrangements of dice has, among all the possible arrange- 
ments, chosen one by chance selection, then it is much more probable 
that a general factor exists in the first than in the second case This 
probability will in fact rise and fall with D though it is not measured by D 
But if the person making the arrangements of dice has any definite rules 
which he follows in making the patterns, then the above probability 
will have much less meaning 

Before leaving for the present the subject of dice throws two points 
may be mentioned. (1) Negative correlations may be imitated by dice 
being added to one, but subtracted from the other, variable*^. (2) There 
are many ways conceivable m which correlations can be produced other 
than by tangible common factors. Consider for example the positive 
correlation between the number of hearts in my hand and the number 
of spades in my partner’s, at whist. 


(4) MULTIPLE CORRELATION 

For many purposes workers in experimental and educational psycho- 
logy need not only the first partial correlation coefficient described on 
p 137, but also coefficients giving the correlation when more than one 
variable is kept constant. A very important case is when it is desired 
to weight a team of tests so as to correlate as highly as possible with 
some criterion, e g school success, or abihty in a trade. This task can 
be carried out by finding all the intercorrelations of the tests with one 
another and with the criterion, and thence finding the regression equation 
in the manner explained below, with the criterion on the left and all 
the individual tests on the right The coefficients of that equation will 
indicate the way in which each mdividual test score should be weighted 
to give the highest correlation of the team with the criterion. Methods of 
shortening the arithmetic have been given by Toopsf and by Chapman J. 

The classic memoir on the theory is that by Professor Karl Pearson 

* See J. R Thompson, “The Role of Interference Eactors in Prodnomg Correlation,” 
Bnt Journ of PsycJiol 1919, X pp 81 — 100, 

t Joum, Educ Psychol 1922, v p 68. 


t Ibid. 1922, V. p. 263. 
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on ‘‘Eegression, Panmixia and Heredity,” in 1896*^, winch is however 
too advanced for quotation at any length here In 1907 Mr G Udny Yule 
introduced a new notationf and made various improvements, and his 
formulae will now be briefly summarised 

If X 2 i . Xn denote deviations from means, the equation expressing 
the regression of on .. Xj^^ is 

~ ^12 . 34 “b ^13 . 24 n^Z ”b . + , 23 n-l^nf 


where 


^2 34 n 

(1 - ^ 12 ^ (1 - ^^ 3 . 2 ) (1 - ^^14 23 ) ■ (1 - » 

r = ^12 . 34 n-1 ~~ 34 ^ 2 ?? 


in 23 n-1) 7 


{1-A..34 

^ 12.34 n is known as a “partial” correlation coefficient, being the value 
of the correlation between 1 and 2 for constant values of 3, 4 , n 

Similarly, 612.34 n is a “partial” regression coefficient. Knowing the 
“total” correlations rgg, etc , we are enabled to obtain the various 

partial coefficients by successive substitutions. Thus, in the case of three 
variables, 1, 2, 3, we have 


and two similar equations, expressing the value of the correlation between 
two of the variables for a constant value of the third J. If a fourth 
variable be added, we have the further set of equations 

^12.3 ^14.3^24.3 

Perhaps a more convenient formula for obtaining the partial corre- 
lation of two variables for constant values of a third and fourth is 


r = »‘l 2 (1 - ^34^) - ^13jl23 - " >'23^3l) 

When the partial correlation coefficients have been determined, the 
regressions can be found by substituting in the appropriate equations, 
and give at once the regression equations As explained before, a 
regression equation gives the most probable value of one variable for 

* Phil Trans cxcvxn A, pp. 443—459 

t Proc Roy Soc 1907, iiXXix A, pp. 182 — 193 

t Pot an mterestmg representatioa of correlation between three variables by a model 
showing the distribution of points m space, see G Udny Yule, An Iniroduciion to the 
Theory of StatisttcSf C. GniSin and Co., London, 1911, pp. 241^ — 243. 


B. &:T. 
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given values of the remaining variables, the standard error m such a 
prediction being correlation between measured values 

of and the values of calculated, by means of the regression equation, 
from Xq . Xn is ^gs n)> where* 

1 — i2\.{23 ^12^) ^“ 13 . 2 ) (1 ^^ 4 . 23 ) •“ "" 23 w~l)- 

Thus, for example, suppose that is proficiency in a trade after a 
year’s experience, and tCg, x^ and x^ are three tesbs which were given 
before the year’s work was entered upon Then in any future group tested, 
the best prediction as to trade ability a year hence will be obtained by 
combining the scores m % and with weightings as in the regression 
equation 

^12 , 34^2 d" ^13.24^3 “b bi4 . 23^4* 

And this predicLion may be expected to correlate with that future success 
to an extent ( 234 ) g'^ven by the equation just abovej. 

An example of the method of applying the above formulae is given 
in the next few paragraphs, where the partial correlations, regressions, 
etc in the case of four interrelated psychical capacities are worked out 
on hnes identical with those illustrated by Mr Yule in his paper. 

Example of Multiple Correlation^ 

{Boys, ages 11 — 12, n — 66.) 

1. Crossing through two letters (e and r). 

2. Crossing through four letters (a, n, 0 , s). 

3 Combmation test 

4 Mechanical memory test. 

Formula: 

^12 34 n-l ~~ ^Iw . 34 n-1 ^2n . 34., w-1 
12 .34 n /-I __ 2 /I ^ ' 

^ in. 34 n-l) ^ 2n . 34 n-li 

* It is of interest to note that the formula for can be obtamed from Spearman’s 
formulae for the correlation of sums by makmg the latter a maximum (equating differentials 
to zero) 

t See for example Toops, TTode Tests %n JEJducahon, Teachers’ College, Columbia TTni- 
versity, 1921, and Clark L. Hull, Journ Educ Psychol 1923, xiv. p 396. 

J; W. Brown, Bnt, Journ, of Psychol, 1910, m p 317. 
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For four variables tbis becomes* 


' 12.34 • 


'12.3 


'14.3'24.3 




^ 12.3 — 


^12 ^ 13^23 

(l-ri3^)i(l-r,32)r 

Table I 


Correlation coefficient 

1 

log(l-r“} 

12 

0 78 

I 59284 

13 

0 45 

190173 

14 

0 40 

1 92428 

23 

0 48 

1 88627 

24 

0 29 

I 96185 

34 

0 52 

1 86308 

Table II 


Correlation coefficient 
(zero order) 

Product term 
of numerator 

ISTumerator 

Correlation coefficient 
(first order) 

log(l-r2) 

12 

1 0-78 

0 2160 

0 5640 

12 3 

0 7199 

I 68281 

13 

i 0 45 

0 3744 

0 0756 

13 2 

0 1377 

1 99169 

23 

1 0 48 

0 3510 

01290 

23 1 

0 2308 

1 97623 

12 

0 78 

01160 

0 6640 

12 4 

0 7570 

1 63038 

14 

0 40 

0 2262 

0 1738 

14 2 

0 2902 

1 96179 

24 

0 29 

0 3120 

-0 0220 

24 1 

-0 0386 

i 99348 

13 

0 45 

0 2080 

0 2420 

13 4 

0 3091 

1 95639 

14 

0 40 

0 2340 

01660 

14 3 

0 2176 

1 97893 

34 

0 52 

01800 

0 3400 

34 1 

0 4154 

1 91774 

23 

0 48 

01508 

0 3292 

23 4 

0 4027 

1 92316 

24 

0 29 

0 2496 

0 0404 

24 3 

0 0539 

1 99873 

34 

0 52 

0 1392 ! 

0 3808 

34 2 

0 4536 

1 89990 


Table III 


Correlation coefficient 
(first order) 

Product term 
of numerator 

Numerator 

Correlation coefficient 
(second order) 

logil-r^) 

12 4 

0 7570 

0 1245 

0 6325 

12 34 

0 727 

1 67345 

13 4 

0 3091 

0 3048 

0 0043 

13 24 

0 007 

1 99998 

23 4 

0 4027 

0*2340 

01687 

23 14 

0 272 

i 96662 

12-3 

0 7199 

0 0117 

0 7082 

12 34 

0 727 

— 

14 3 

0 2176 

0 0388 

017S8 

14 23 

0*258 

i 97009 

24 3 

0 0539 

01567 

-0 1028 

2413 

-0152 

i 98985 

13-2 

01377 

01316 

0 0061 

13*24 

0 007 

— 

14 2 

0 2902 

0 0625 

0 2277 

14 23 

0 258 

— 

34 2 

0*4636 

00400 

0 4136 

34 12 

0 436 

1*90843 

231 

0 2308 

-0*0160 

0 2468 

2314 

0 272 

— 

241 

-0 0386 1 

00959 

-01345 1 

24 13 

-0 162 

— 

341 

0 4154 

-0*0089 

0 4243 1 

3412 

0 436 
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The regressioD equation between cbanges m intelligence (as measured 
by the combination test) and changes in the other three variables is 

^3 ~ ^31.24^1 "t" ^32.14^2 "b ^34.12^4* 

Calculation of regression coefficients 

0*2 = 68-195 02 = 58 43, <73 = 16-345 ^■4 = ^ 70, 

<^3.24= <^3 (1 - »'32^)^ (1 - AaJ = 12 77. 

Similarly, 

^1.24” Cr2^ 24 ~ 03 ^ 22 ^ 

wkence 631 . 34 = ^31 34 = -002. 

O'!. 24 

Similarly, &32 . 24 == *099, 634. 12 = *703. 

Hence regression equation is 

Xg = *002x1 + *099x2 + • 703 X 4 . 

The standard error (erg, 224) made m estimating from x^, and 
by this equation 

= a 3 (1 - r 3 ,^)^ (1 - r232.i)* (1 - >-^ 34 . 12 )^ = 12*78 

The multiple correlation iK3.(i24) of the measured x^ with the x^ 
estimated by this equation is given by 

(124) = 1 — (1 — ^^ 31 ) (1 ~ ^^ 32 . 1 ) (1 ^^34. 12 )? 

■®3.{124) ^•62. 

(5) SPURIOUS CORRELATION 

Correlation is said to be spurious when it is due to extraneous con- 
ditions and does not arise directly out of the functions under con- 
sideration. The term is one of relative and not of absolute significance, 
but its appropriateness wiU become apparent after a consideration of 
the followmg two examples: 

1. Heterogeneity of materiaL 

Let us suppose that two distinct groups of children have been 
measured for two characters A and B, and that the mean abihties, m 
both A and B, are higher in the one group than in the other. Then, 
even if there is no correlation between the two characters, as estimated 
from each group separately, a positive correlation will be obtamed from 
the two groups taken together On the other hand, if the mean ability 
in ^ is higher, and the mean abihty in B lower, in the one group than 
in the other, a negative correlation wiU be obtained by taking the twO' 
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groups together. The correlation in each case will be due simply to the 
heterogeneity of the material employed The difference in the mean 
values for the two groups must of course have some cause, such as a 
difference of nationahty, sex, or even locahty (within any one town or 
district) from which the children are drawn, or, again, such a cause as 
the diSerence of discipline to which the two groups have been subjected 
in the past These are extraneous conditions and, if measurable, can 
be allowed for by employing the method of partial correlation. As a 
rule, however, they are not easy to deternune quantitatively, hence 
their dangerous character. 

2. Index Correlation"^. 

This is a form of spurious correlation which arises from the use of 
ratios for measurements. Thus if 



and Xi, X 2 , Xq are uncorrelated with one another, it can be shown that 
the correlation between % and 23 is 



a quantity which may be as large as 0 5. 

As an illustration from psychology, we may mention the correlation 
of intelligence quotients and achievement ratiosf. An i q is mental age 
divided by chronological age, an a r is educational age divided by mental 
age. Two i q ’ s (found perhaps by two tests, or m successive years) will 
show r = 0 5 even if the mental ages are quite uncorrelated with one 
another or with age An i Q. and an a r may show r — 0*5, for here 
mental age is denominator of one and numerator of the other Partial 
correlation, making the common element constant, will eliminate 
spurious index correlation. 

* Karl Pearson, “On a form of Spurious Correlation whicb may arise 'wlien Indices 
are used m the Measurement of Organs,” Proc Roy 80 c 1S07, lx p* 4S9. In a note 
following Pearson’s paper Sir Francis Galton illustrates the occurrence of index correlation 
by a simple and illummatmg example 

t See Pmtner and Thomson, J ourn. Mduc. Psychol 1924, xv p. 433. 
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(6) VARIATE DIFFERENCE CORRELATION, OR THE ELIMINATION OF 
SPURIOUS CORRELATION DUE TO POSITION IN SPACE AND TIME* 
Tins IS a method for determining the correlation of variations from 
the “instantaneous mean/’ by correlating corresponding differences 
between successive values. If two variates x and y are such that 

X — <f> (t) -j- A, 
y=f{t)+Y, 

where X and Y are the parts of x and y independent of the time then 
it can be shown that on certain not unreasonable assumptions, 

if m is large enough, where is the mth difference between successive 
values of x, and similarly For example 

^ ’iPx fix 


47 

53 

55 

57 

58 


6 

2 

2 

1 



Clearly the number of corresponding cases to be correlated is reduced 
each time. The method is only vahd, inter aha, when there are so many 
cases in the x column that this reduction is immaterial. The following 
numerical example will it is hoped serve to make clear any obscure 
points m the above necessarily short account. The correlations between 
differences are worked out until r remains steady for several successive 
differences. 


Numerical illustration of the Variate Difference Correlation Method/^ 

The numbers headed Savings and Tobacco respectively are “indices” 
from Professor Georgio Mortara’s article in the Giornale degli Economiste 
e Rivista di Statistica, February 1914. As they stand, they include a 
continuous secular increase both of savings and of consumption of 
tobacco which has occurred in Italy during the period m question, and 
their correlation is *984. But first differences only correlate to an extent 
•766 as IS shown in detail in the following working* 

♦ Miss F. E. Cave, Proc. Boy Soc 1904, Lxxiv. p. 407; R. H, Hooker, Joum, Boy, 
JStat.Scc 1905, nxvm p 396, “Student,” Biometrika, 1914 — 15, x p. 179; and Anderson, 
BtometriJca, 1914 — 15, x p. 269, where probable errors are given. 

f From Beatrice M Cave and Karl Pearson, Biometnkai 1914 — 15, x. p 340. 
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In the table the vanate a; is the Savings Index, y is the Tobacco 
Index. We then have 


Mean of = 145/27 = 5 37, 

Mean of ^Dy = 69/27 = 2-56. 

Take 5 and 3 as provisional centres, so that di = *37, dg = — '44. 
From deviations from these points we get, as shown in the table, 

/S(iZ>,2) = 606, 

<S{iD*iZ),) = 247, 

8 (iD/) = 220. 

Therefore the correlation (correcting for dj and dg) is 


247 + 5 

^ Visoe - 4) V(220 - 5) 


= -77. 


Second differences have a small negative correlation, which increases 
till with sixth differences we reach — *431, which seems to indicate that, 
when time has been eliminated, expenditure on tobacco in any year 
means less money saved. 


Note, 1924. The coefficient of alienation Kelley has m recent years emphasised the 
coefficient h = '\/(l - r®), one effect of which is to inculcate caution m emplo3ung correlations. 
Consider the correlation r between two mtelhgence tests Till lately, a correlation of 0 8 
would have been considered very satisfactory 

If we know an individuars score on the first test, we can predict his most probable 
score on the second test But the actual performances of a number of such mdividuals m 
the second test will be scattered with a sigma equal to h<y (pp 109 and 111 hereof), where 
cr IS the sigma of all second test scores The probable error of our prediction, that is, is 
reduced to the fraction h of what it would be did we guess at random 

Now for r = 0 8, & = 0 6, and this reduction to 0 6 of the error is not a very startlmg im- 
provement on guessmg. So r = 0 8 means less to us, as an indication of predictive power, 
than we were accustomed to thmk It takes a correlation of 0 98 to reduce the probable 
error of a prediction to one-fifth of the probable error of a mere guess. 



CHAPTER VIII 

THE GOREECTION OF EAW CORRELATION COEFFICIENTS 

Historical accoHn+— ^The elimination of irrelevant factors — Correction for observa- 
tional errors (attenuation) — Coireiation of gains and imtiai values, 

(1) HISTORICAL ACCOUOT 

The Instorj of tlie use of the theory of correlation in Psychology can 
hardly be said to have begun earher than the commencement of the 
present century. During the previous twenty years, indeed, a great deal 
of work had been done by many observers in measuring simple mental 
abihties (by the ‘^mental test” method) m larger or smaller groups of 
subjects, and attempts had even been made to determine in what way 
these abihties were related to one another and to more general mental 
abihty, or ‘'general intelhgence.” 

Owing, however, to a umversal lack of knowledge of the mathe- 
matical theory of correlation among psychologists during this period, 
the results were not obtained in a form suitable for comparison with 
one another, so that it is not surprising to find that they hopelessly 
contradict one another. The heterogeneity of the material worked 
with, the non-elimination of irrelevant factors, and the absence of any 
measure of the "probable error” of the results make the conclusions 
drawn by the investigators themselves from their researches utterly 
unreliable. 

The first investigation showing any mathematical precision was that 
pubhshed by Clark Wissler* in 1901. It contained {inter alia) an account 
of the careful apphcation of a large number of simple mental tests upon 
over 200 college students, and a correlation of the results with one 
another and with the students’ marks in the various subjects of the 
college cuxnculum. The mental tests were found to correlate but slightly 
with one another or with ability in college subjects of study, though 
these latter showed considerable correlation with one another (-30 — *75). 

In the following year Aikens and Thorndikef published results which 

* Clark Wissler, “The Correlation of Mental and Physical Tests,” Fstfchologtcal 
Eevtew, Monograph Supplement, m No. 16, June 1901 

t “Correlations among Perceptive and Associative Processes,” Psychological Review, ix. 
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were m a sense confirmatory of those of Wissler, since, notwithstanding 
the greater similarity to one another of the functions investigated than 
in Wissler’s research, the correlations were again found to be low For 
example, different tests devised for the measurement of ‘'speed of 
association” were found to show hardly any correlation — a result which 
seemed to furnish some justification for the author’s statement that 
“quickness of association as an abihty determining the speed of all one’s 
associations is a myth” (op cit. p. 375). A sirmlar lack of close relation- 
ship was found in the case of other mental functions which would, on 
the evidence of introspection alone, be confidently classed as particular 
instances of the same general mental function. 

In 1904 there appeared an epoch-making article by Professor C. 
Spearman*, the ideas originating m which have, at least in England, 
ever since dominated correlational work in its applications to psychology. 
Since we shall have frequent occasion in the course of this and the 
succeeding chapter to take exception to Professor Spearman’s theories 
and mathematical methods, which appear to us incorrect and harmful, 
we may perhaps be allowed at this point, before embarking on contro- 
versial matters, to express our opinion that only Professor Spearman’s 
enthusiasm and originahty could have given to psychological correlation 
research the hfe and activity which it has shown during the last fifteen 
years. His work has stirred up both disciples and opponents to investi- 
gations which would otherwise never have occurred to them. 

The new ideas in question fall into two main groups. 

(1) Corrections to the raw values of correlation coefficients. Instead of 
measuring large numbers of individuals, as his predecessors had done. 
Professor Spearman contented himself with small numbers, groups of 
less than 40 in his first research, and as few as 11 m the second, but he 
proposes to make up for the unrehabihty thus introduced into the 
results by a more careful measurement of his cases, and the apphcation 
of “corrections” to the “raw” values of his correlation coefficients by 
means of appropriate mathematical formulae. 

(2) The discovery of “ hierarchical ” order among correlation coefficients, 
and the Theory of General Abihty, or the Theory of Two Factors, which 
has been built up on this foundation. This theory has been a great incentive 
to research, and may possibly correspond to the facts, though we do 
not inchne to think so. But its deduction from the occurrence of 
“hierarchical” order among the correlation coefficients is mvahd, as 

♦ “General Intelligence objectively determined and measured,” Amer. Journ, of 
Psychol XV pp. 201 — 292. 
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will be sbown in the next chapter In the present chapter we turn to 
the closer consideration of the first group of ideas, the correction of raw 
correlation coefficients 

(2) THE ELBONATION OP IRBELEVANT PACTORS 

The first kind of correction is that for the elimination of irrelevant 
factors, and is nothing new in the theory of correlation, being simply 
the method of partial correlation described in the last chapter 

For example, to eliminate the efiects of diSerence of age in the group 
experimented upon, one would determine the partial correlation between 
the two characters under consideration, for ‘'age constant,” by means 
of the Yulean formula given on p. 137 A similar procedure is needed 
for eliminating the eSects of difference of sex, etc A preferable course, 
however, would be to dispense as far as possible with the necessity for 
such corrections by selecting groups of individuals of the same age, 
sex, etc. Indeed, as Professor Spearman very properly points out^, 
the partial correlation formula must on no account be used in cases 
where there is too violent heterogeneity of the irrelevant factor. For 
example, we might with justice use it to eliminate the effects of age in 
a group where the extreme differences of age were only over a range of 
two or three years, but not in a group where the subjects ranged from 
say five years to fifteen years of age. 

The second kind of correction introduced by Professor Spearman is 
a correction for what he calls “accidental” errors This correction is 
based on the “reliabihty coefficients” introduced by Professor Spearman 

(3) CORRECTION EOR OBSERVATIONAL ERRORS (ATTENUATION) 

It is by the aid of these rehabihty coefficients, as we have said, that 
Professor Spearman carries out the calculations which have for their 
object the ehmination of observational errors. 

It IS clear that if the correlation between two series of quantities is 
really perfect, it must be reduced by observational errors and if im- 
perfect, it will stiU tend to be reduced The amount of this reduction 
will probably be greater, the greater are the observational errors The 
size of these is however indicated to some extent by the reliability 
coefficients, so that it is but a short step to use these to correct for the 
reduction, and enlarge the correlation coefficient to its true value. An 
example given by Professor Spearman himselff shows this so clearly 
that it is not out of place to repeat it here 

* “Demonstration of Formulae for the True Measurement of Correlation,” An er 
Journ. of FsycM. 1907, xvm espeeiaBv p ICG. 

t Ajwer. Jmrn^ of Psychol 1904, xv. p 27L 
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“A target was constructed of a great many horizontal bands, num- 
bered from top to bottom. Then a man shot successively at a particular 
series of numbers in a particular order Clearly, the better the shot, the 
less numerical difference between any number hit and that aimed at, 
now, just as the measurement of any object is quite appropriately 
termed a 'shot’ at its real value, so, conversely, we may perfectly well 
consider the senes of numbers actually hit in the light of a senes of 
measurements of the numbers aimed at. When the same man again 
fired at the same series, he thereby obtained a new and independent 
series of measurements of the same objects. Nest, a woman had the 
same number of shots at some set numbers in a similar manner If, 
then, our above reasoning and formulas (see below) are correct, it should 
be possible, by observing the numbers hit and working out their corre- 
lations, to ascertain the exact resemblance between the series aimed at 
by the man and the woman respectively In actual fact, the series of 
numbers hit by the man turned out to correlate with those hit by the 
woman to the extent of 0*52; but it was noticed that the man’s sets 
correlated with one another to 0*74, and the woman’s sets with one 
another to 0*36, hence the true correspondence between the set aimed 
at by the man and that aimed at by the woman was not the raw 0*52, but 

V{0-7i X 0-36) 

that is to say, the two persons had fired at exactly the same series of 
bands, which was really the case ” 

It will be seen that the formula for correction is “divide the raw 
correlation by the geometrical mean of the two reliability coefiS-cients.” 
This formula, or rather the more accurate formula of which it is an 
approximate form, we shall prove presently. Meanwhile it must be 
pointed out that only by a coincidence does the above corrected value 
happen to agree exactly with the true value. One of us (Thomson) has 
carried out a similar experiment a sufficiently large number of times to 
enable the distribution of the corrected coefficients to be compared with 
that of the raw values The “errors” were introduced by dxawmg cards. 
The “ population” (corresponding to the number of shots) was throughout 
32, The results were as shown in the table on the next page. 

It will be seen that the corrected values are scattered considerably 
about the true value, even when the errors are as here uncorrelated, and 
that in many cases the corrected value is worse than the raw, though 
the median corrected value is better than the median raw value. 
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Large 

errors 

Small 

errors 

Large 

i 

errors 

Small errors 



Cor- 


Cor- 


Cor- 


Cor- 


Raw 

rected 

Raw 

rected 

Raw* 

rected 

Raw* 

rected 

Highest 

0 656 

1 34 

0 678 

0 88 

0 746 

1 37 

0 827 

1 19 

Upper quartile 

0 550 

0 87 

0 555 

0 71 

0 623 

1 15 

0 772 

1 04 

Median 

0 433 

0 79 

0 467 

0 65 

0 559 

1 01 

0 732 

101 

Lower quartile 

0 328 

0 67 

0 402 

0 60 

0 493 

0 85 

0 607 ! 

0 97 

Lowest 

0163 

044 

0 281 

0 46 

0 327 

0 68 

0 579 

0 82 

Ho of values 

25 

loot 

25 

loot 

20 

30 1 

20 

30t 

True value 

0 667 

0 667 

0 667 

0 667 

loco 

1 000 

1000 

1030 


* These were also the reliability coefficients of columns 1 and 3 

t There are more corrected than raw values because the latter can be grouped in 
various ways 


The fact is, that the assumptions underlpng Professor Spearman’s for- 
mula may not be fulfilled m practice What these assumptions are can 
best be seen from the elegant proof given for the formula by Udny Yule"^. 
and yi are measures of x and y at a certam senes of measurements, 
X 2 and ^2 measures of x and y at another senes of measurements. 
Let x^-= x + S^, a-g = a: -f Sg, 




all terms denoting deviations from means. 

Then, if it is assumed that S, €, the errors of measurement, are 
Tin correlated with one another or with x or 

S (xS) etc. == 0, S (x^yi) == S (xy). 


Hence 

and similarly 


'^x^yi^xf^Vx ” '^xv^x^yi 


or 

But also, since 
and 

or 




■^xi 

, A 

X 


;S(x8) = 0, -S (a-iTa) = -S (x2), 

^XxXz^Xi^Xz ~ 

* x^x» ‘ y-iVz 


♦ See Appendix (e) to Professor Spearman’s article. Bnt Journ of PmjtM 1910, ni 
p 294 There is a printer’s mistake of omission in the last formula See also W Bruvm, 
“Some Experimental Besults m Correlation,” Gomptes Bendiis du Fi”“ Congrh Inter- 
nalioTKd de Fsychologie, Genbve, 1910, where the same proof is quoted 

f Whence Kelley’s formula that true sigma is observed sigma times root of reliability, 
J. of Mduc, Faychol 1919, x p 229, 
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4 __ '^xiVi'^XiVi^Xiyz'^XzVi 
' X\.X%’ VxVt 

Geom Mean of correlation coefficients 
Geom. Mean of rehabilxty coefficients * 

It is tins formula which is employed in Thomson’s example given above. 
In Spearman’s example, the numerator consisted only of 
the subcalculations for etc not being made 

Attention must be drawn to the assumption that the errors of 
measurement 8 and e are uncorrelated with each other or with x ox y 

Now, these are very large assumptions to make Even in cases where 
the quantities 8, € are genuine errors of measurement, there are strong 
reasons for assuming (on general principles and also from experimental 
evidence)* that they will be correlated. But in the case of almost all 
the simpler mental tests the quantities 8 and € are not errors of measure- 
ment at aU They are the deviations of the particular performances from 
the hypothetical average performance of the several individuals under 
consideration Thus they represent the mnabihty of performance of 
function within the individual. When an individual m the course of 
three minutes succeeds in striking through 100 e’s and r’s m a page of 
print on one day, and 94 under the same conditions a fortmght later, 
there is no error of observation involved The numbers 100 and 94 are 
the actual true measures of ability on the two occasions. The average 
or mean ability, which is the more interesting measure for the purposes 
of correlation, is doubtless diSerent from either, but that does not make 
the other two measures erroneous. Evidently in these cases 8 and e 
represent individual variability, and to assume them uncorrelated with 
one another or with the mean values of the functions is to indulge in 
somewhat a priori reasoning. 

There are two comparatively simple ways of testing the assumption: 

(1) S (x^y,) = S (xy) = S {x^z)> 

^ ~ ^ (* 22 / 2 ) should = 0 within the hmits of the probable 

error of the difference. 

The probable error of S {xy) is equal to 

•67449 

In applying this to determine the probable error of the difference of 

♦ See Karl Pearson, ‘'On the Mathematical Theory of Errors of Judgment, with 
special reference to the Personal E(iuatxoii,” Phil Trans oxovnL A, pp. 235 — ^299. 
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S (aJi2/i) and 8 (x^y^) one must bear in mind the possibility of these 
quantities being correlated. 

(2) ty -^ = ^ ~ (.Vi ~ %)} 

Fi:f: vs S y,)^ 

Vs (Bj. — 82)^. /S (ci — €2)^ 

= 0 , 

if errors are tincorrelated with one another (since numerator then = 0). 

Applying this test to a case of bisection and tnsection, Brown gets 

= 0*30 ± 0’09, 

Tr-T, 

which proves the inapphcabihty of the formula here 

Brown applied test (2) also to a case of correlation between speed 
of addition of figures and accuracy of addition in a group of 38 school- 
children (girls between the ages of 11 and 12) and found 

^ 0*35 ± 0*09. 

Ai — At 

Even when test (2) does give the value 0, we can only conclude from 
this that ;S (§1^) + S (SgCg) == S (S^eg) + S (SgCj). 

Eepl 5 ang to these and other criticisms of his formula for ehmmating 
observational errors, Professor Spearman* admits that many forms of 
error will be correlated with each other and with the true values of the 
quantities measured. But these, he says, are generally of a continuously 
progressive nature, and he proposes to elimmate their influence by 
making at least three measurements of x, and taking the first and third 
of these together as the x^ of the formula, the middle one as X 2 , ot to 
use more comphcated but essentially similar devices No doubt, of 
course, this is a wise precaution to take, even though sceptics may still 
doubt whether the remaining so-called ‘'accidental” variations are even 
yet uncorrelated with each other and with x and y 

Brownf, using experimental data obtained by two independent 
observers estimating the lengths of Imes, foimd a considerable corre- 
lation ratio between the errors of observation and the true lengths of 
the lines, the regression being very far from linear He is of opinion 
that “no assumptions as to the correlation or non-correlation of such 
deviations are m the least justified.” 

The correlation ratios between lengths and errors, and the corre- 
sponding regression curves, are shown on the opposite pagej. 

In a review of Brown’s article Mr J. R. Wilton § has made some 

* Bnt Journ FsyMl 1910, m. p. 271 t 1913, vl p 223. 

J JVom Bnt, Joum Psychol 1913, vi. pp 236 — S. 

§ Journ, of Exp Pedag, 1914, n. p 302. 
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ingenious suggestions for weighting the different cc’s in a manner sug- 
gested by quadrature formulae He lemarks also that a grouping 
should be sought which would as far as possible satisfy the assumpuons. 

It may finally be pointed out that even %f the errors S and e weie 
Icnown with certainty to he uncorrelated with each other and with the true 
values^ yet, with such small numbers of cases as are used in many of the 
psychological researches in which Professor Spearman^ s formula has been 
employed, the chance of, eg S being nearly equal to S {x^y^ is 

exceedingly small, and it is difficult to attach any meaning to an artificial, 
post hoc separation of the data into halves such that this condition is 
satisfied (and also others). The formula is at any rate inapphcable to 
samples such as 30, 24, 52, which have been freely used in experimental 
work, or if used at all, it can only be as a guide to the sufficiency of the 
sample. It is an essential of good work to use such samples that correc- 
tions to the raw values obtained are unimportant. 

Regression Curves of Correlation Table 


— Errors made, m mm 



r =0 033±0 030, 

97^ = 0 182 ±0*029, 

Vv = 0*323 ± 0*027. 

(4) AN ABTmCIAL ILLUSTRATIVE EXAMPLE 
Many of the above considerations may be illustrated by the following 
artificial example. 
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I\rst let us remind the reader that followmg the bmomial law discussed m Chapter n, 
symmetrical distributions of one variable run in such ways as 1 • 2 * 1 if there are three 
values, or 1 3*3 1 if there are four. K x and y are uncorrelated, and 16 cases of x are 
distributed over three values thus 

4 8 4 

then each of these will be distributed vertically as regards y m similar fashion giving 

11 ^ ^ 1 

2/2 4 2 

^1 2 1 

which is a table showing zero correlation of x and y» 


(a) Errors uncorrelated Attenuation correction permissihle. 

Consider now a correlation table for x and y for which true r = 0*667 


16 

16 

0 

0 

16 

48 

32 

0 

0 

32 

48 

16 

0 

0 

16 

16 


Taking the columns and rows as unit distance apart we have 

S jxy) 128 2 

192 ~ 3 ’ 

Suppose that uncorrelated errors splash each 16 cases over an area thus- 

1 2 1 

2 4 2 

1 2 1 


where the unit is the same The resulting observed correlation table is 
as follows and gives r == 0*4 : 


1 

3 

3 

1 

0 

0 

3 

11 

15 

9 

2 

0 

3 

15 

28 

24 

9 

1 

1 

9 

24 

28 

15 

3 

0 

2 

9 

15 

11 

3 

0 

0 

1 

3 

3 

1 


Again taking the columns and rows as unit distance apart we have 
S(xy) 

VSx^Sy^ 320 

^ Notice that S (xy) is unaltered by the attenuation. It is S (x^) and 
S which change, i e. o* changes 

It can by similar methods be shown that the reliabihties are 

= 0-6 


For were there no errors, the reliability would be unity and the correlation of either 
variable with its own identical and correctly measured self would give a correlation table 
like this: 32 0 0 0 

0 96 0 0 

0 0 96 0 

0 0 0 32 


B.&'r. 


11 
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Errors of the same nature as those above would splash each 32 or 96 cases over an area 
and the observed table would be 


2 

4 

2 

0 

0 

0 

4 

14 

16 

6 

0 

0 

2 

10 

32 

24 

6 

0 

0 

6 

24 

32 

16 

2 

0 

0 

6 

16 

14 

4 

0 

and this table gives r* 

0 

=0 6. 

0 

2 

4 

2 


By Spearman^s formula tlie corrected value for r^y is then 0-4/0‘6 = 0*667, 
which, agrees with the true value. 

(5) Errors correlated. Attenuation correction misleading. 

Consider now, however, this parallel case in which the true correlation 
of X and y is only 0*33 thus : 

8 16 8 0 

16 40 32 8 

8 32 40 16 

0 8 16 8 

Let correlated errors splash each 8 cases over an area thus: 

110 
1 2 1 
Oil 

If the reader wdl carry this out he will obtain this correlation table: 

13 3 10 0 

3 11 15 9 2 0 

3 15 28 24 9 1 

1 9 24 28 15 3 

0 2 9 15 11 3 

0 0 1 3 3 1 

identical with that obtained under case {a) and again giving r = 0*4. 

The rehabilities however are now different and can be seen to be 
= 0 - 8 . 

For the true reliability table 

32 0 

0 96 

0 0 

0 0 

IS converted by these correlated errors into 

4 4 0 

4 20 16 

0 16 40 

0 0 24 

0 0 0 

0 0 0 

giving Tx or r^^—O'S. 

If we correct the observed r^^y for attenuation therefore we obtain 
r = 0*4/0*8 ~ 0*5, whereas the true value is 0*33 and the correction is 
in the wrong direction. This undesirable phenomenon would seem to be 


0 0 

0 0 

96 0 

0 32 


0 0 0 

0 0 0 

24 0 0 

40 16 0 

16 20 4 

0 4 4 
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particularly liable to occur when attenuation corrections are made by 
splitting a test, smce a boy who is oS colour in one part is very likely to 
be also ofl colour m the other and hence errors will be correlated 


(5) CORRELATION OF INITIAL VALUE OF A MENTAL FUNCTION 
WITH ITS GAIN OVER A CERTAIN PERIOD 

Observational errors, which if uncorrelated tend to deflect an ordinary 
correlation inward toward zero, further tend, in the special case of 
correlation of gams with initial values, to depress r towards — 1, as was 
discovered by Thorndike’^ The two efiects augment one another in the 
case of positive correlations but are opposed if the correlation is negative. 
The present correctionf is particularly important in correlations con- 
cerning learmng and practice, annual changes in intelligence, etc. 

Let a = true initial value, 

g = true gam, 
a -f- ^ = true final value, 

e = error of measurement in initial value, 
e' = error of measurement in final value, 

X = measured initial value, 
y = measured gam, 
z = measured final value, 


then z = x-{-y, 

X = a 4- e, 

21 = a -f ^ + e', 

The reason for the reduction m the apparent correlation of x and y is 
the presence of -f e in a? and of ~ e in y. If a and g are really uncorrelated, 
this will cause an apparent negative correlation 

Thomson has then shown that, on the assumption that e and e' are 
not correlated with one another or with g ox a (assumptions similar to 
those made in using Spearman’s attenuation formula), 

<yv^xy 4- Oar (1 ^x) 

r„ - _ ^^2 (i _ (i _ r,)] 


and also 




+ r,or/ - ’ 


where and r* are the reliability coefficients of x and s That is, r^, is 
the correlation of two measurements of x and is the correlation of two 
measurements of z, must not be used as a reliabihty coefficzent here. 


♦ Jown. Exp* Psychol 1924 

t Godfrey H. Thomson, Joum* Exp Psychol 1924, vii p 321, 

11—2 



CHAPTER IX 


THE THEOEY OF GENEEAL ABILITY 

This apparent umiy is illusory Man^ in fact, is a microcosm as complex as the 
world which is mirrored in his mind, he is a federation incompleiely centralised, a 
hierarchy of numerous and conflicting passions, each of which has ends of its own, and 
each of which, separately considered, would give a different law of conduct Ee is in 
some sense a unit, hut his unity is such as to include an indefinite number of partly 
independent sensibilities, 

Leslie Stephen, The Science of Ethics, p. 69 

Discovery of “Hierarchical” order among correlation coefficients — ^Use of the 
formula for the correction of observational errors to prove the existence of a 
general factor — Researches between 1904 and 1912 — A criterion for hierarchical 
order apphed to numerous researches — Comphcations m the original theory 

(1) DISCOVERY OF HIERARCHICAL ORDER AMONG CORRELATION 

COEFFICIENTS* 

The controversy as to wliether ability in any individual is general, or 
specific, or m groups or ‘‘faculties” is a very old one, but for the purposes 
of the present chapter it is not necessary to go back prior to 1904, in 
which year there was pubhshed the first f of a series of articles m which 
Professor C. Spearman has developed his Theory of General Abihty, or 
Theory of Two Factors, as it is alternatively named. 

Professor Spearman’s method in that paper was to measure a number 
of mental abihties, some of them school subjects, others artificial tests, 
in a number of persons, and calculate the correlation coefficients of each 
of these activities with each of the others. These correlation coefficients^ 
he then noticed, had a certain relationship among themselves, a relation- 
ship which may be called hierarchical order, and is explained in detail 
later. He saw, quite rightly, that the presence of a general factor would 
produce this hierarchical order among the coefficients, and, reversing 
this argument, he concluded that the presence of hierarchical order 
proved the existence of a general factor. 

In this first senes of investigations Professor Spearman used the 
following groups of subjects: 24 village school-children of both sexes, 

* Sections 1, 3 and 5 of this chapter are largely extracts from an article by G. H.. 
Thomson m the Psychological Review, 1920, xxvn. p. 173. 

t “General Intelligence objectively determined and measured,” 0. Spearman, Am&r,, 
Joum, Psychol, 1904, xv pp. 201 — ^293. 
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age limits 10 0 to 13-10; 23 boys of a high class preparatory school, 
age hmits 9-5 — 13-7, and 27 adults of both sexes, age hmits 21 — 78 
The tests employed were those for pitch discrimination, weight dis- 
crimination, and discrimination of hght intensities, and measures of 
intelhgence were obtained, in the case of the children, from results of 
school examinations, grading by teachers, and grading of one another 
by the children themselves (measure of common sense) 

The various school subjects in the preparatory school were found to 
correlate highly with one another, and when, with the inclusion of pitch 
discrimination and music, they were arranged in rows and columns, it 
was found possible to place them in such an order that the correlation 
coefficients formed a Imrarchj, each being (with very few exceptions) 
greater than any to the right of it in the same row, or below it in the 
same column, thus 



Classics 

French 

English 

Math 

Eiscnm 

IVlusic 

Gassics 

— 

0 83 

0 78 

0 70 

0 06 

0 63 

Prencti 

0 83 

— 

0 67 

0 67 

0 65 

0 57 

Enj^lish 

0 78 

0 67 

— 

0C4 

0 54 

0 51 

Math 

0 70 

0 67 

0 64 

— 

0 45 

0 51 

Discnm 

0 66 

0 65 

0 54 

0 45 

— 

0 40 

Music 

0 63 

0 57 

0 51 

0 51 

0 40 

— 


This fact of ‘^hierarchical” order which he had thus discovered was 
taken by Professor Spearman to indicate the presence of some common 
fundamental function which saturates m diiferent degrees the diHerent 
activities, and is the sole cause of correlation between them except in 
the case of very similar activities 

It can easily be shown that if all the correlations are due solely to 
one common or general factor, then the correlation coefficients will be 
in perfect hierarchical order * 

Let a and p be two mental tests or other activities, and g be the 
general factor. Then g is the correlation that a would have with p 
for constant g, and equals 

V(1-V)V(1- V)' 

But if g IS the sole source of correlation, , must be zero, i.e. 

Similarly ^6j> — 

Hence similarly == 

. Hart and Spearman. Bnt. Journ. Psychol 1913. v. p 58 qnotmg Yule. Previous 
though less satisfaotoiy proofs had also been given by Spearman. 
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A little consideration of tins last equation shows that, if it be true 
for any four of the tests, it implies the possibihty of arranging the corre- 
lation coefficients in the order we have termed ‘ffiicrarchicar’ and more 
than this, that the values of r m any one column of the ‘^hierarchy’’ 
will bear a constant ratio, each to each, to their partners in any other 
column. 

Since clearly 'perfect hierarchical order cannot be expected in any 
experimental research, it becomes important to know what deviation 
from perfection can be allowed without giving up the idea of a general 
factor* or on the other hand, what approach to perfection can be attained 
without the presence of a general factor. These questions will occupy 
us presently Meanwhile we turn for a while to another form of argument 
used by Professor Spearman. 


(2) USE OF THE FORMULA FOR THE CORRECTION OF OBSERVATIONAL 

ERRORS TO PROVE THE EXISTENCE OF A GENERAL FACTOR 

He considered that by the use of his formula for the correction of 
observational errors he could demonstrate the same thing (the existence 
of a central function”), and could in particular show “that the common 
and essential element in the intelligences wholly coincides with the 
common and essential element in the sensory functions* ” The method 
of proof is as follows 

Let be two distinct measures of sensory discrimination, and 

distinct measures of intelhgence. 

Then the correlation of the function common to the functions 
measured by cCj, with the function common to the functions measured 
fcy is to 




and if the two functions referred to are identical this expression should 
be equal to unity. 

In the present article, Spearman uses a simplified formula, 




and puts for the numerator the average of the various correlations 
Am&t, Joum. Psychol, 1904, xv p. 269 
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evaluated between the inteihgences and the discriminations, and in the 
denominator puts 

= the average correlation of the intellective gradings with one 
another, 

= the average correlation of the gradings in discrimination with 
one another, 

and in this way gets results approximately equal to 1 in the different 
groups tested. 

One or two remarks may appropriately be made here In the first 
place, the full formula is the only one that can be used with any meamng 
or justice since it is the only one which issues logically from the mathe- 
matical proof. In the second place, the applicability of the true formula 
must be considered in the hght of its presuppositions (mentioned above, 
p. 158). 

Indeed, the assumption that S and € are uncorrelated wth each other 
or with X ox y seems even more unwarrantable here than in the case of 
^‘correcting'’ coefficients, for which the formula was originally devised 

(3) RESEARCHES BETWEEN 1901 AND 1912 

A number of experimental researches on these hues, in some of 
which Professor Spearman himself took part, were carried out during 
the eight years following 1904, but with very conflicting results, some 
experimenters finding the hierarchical order among the coefficients, 
others finding no such order Two articles of this penod, for example, 
are those of Mr Cynl Burt*, who found practically perfect hierarchical 
order, and Dr William Browny, who found small trace of such order 
A similar conflict of opinion was found with regard to the alternative 
method of attack, as for example in the research by Messrs Thorndike, 
Lay and DeanJ. The subjects examined were 37 young women students 
and 25 high school boys The tests for sensory discrimination w-ere: 

(1) drawing hnes equal to given hues, and 

(2) filling boxes with shot to equal in weight standard weights ; 
those for intelhgence were: 

(3) judgment of fellow-students, and 

(4) judgment of teachers. 

* C3ynl Burt, “Expenmeutal Tests of General Intelligence,” BnL Jcmm PsycM 

1909, m. pp. 94—177. , -t# ^ i a 

f Wilhaiin Brown, “Some Esrpenmental Results m the Gorrelation of Mental Aomties, 

Bnt Jmm, Psychol 1910, m. pp. 296—322. « 

t Tkomdzke, Lay and Bean, “The Relation of Accuracy m Sensory Biscnimnation 
to General Inteihgence,” Amer, Jonrn, Psyche. July 1909, xx. pp. 364—369. 
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For tlie liigli scLool boys (3) and (4) were combined teachers’ and 
fellow-students’ judgments and school marks, respectively 

In the first case, Spearman’s formula gave for the correlation of the 
factor common to (1) and (2) with that common to (3) and (4) the value 
0 26 %nstead of 1*00, In the second case, the value was 0 29 Moreover, 
Thorndike found a much higher correlation between discrimination of 
lengths and discrimination of weights than between either one of them 
and general intelligence, the coefficients being 

Accuracy in drawing hues, intelhgence 0*15, 

Accuracy in making up weights, intelhgence ... 0 25, 
Accuracy m drawing hnes and making up weights 0-50 
Thus the results were in decided conflict with both parts of Spearman’s 
concluding statement “that all branches of intellectual activity have 
in common one fundamental function (or group of functions) whereas 
the remaining or specific elements of the activity seem in every case 
to be wholly difierent from that in all the others*.” 

Thorndike sums up as follows: “In general there is evidence of a 
complex set of bonds between the psychological equivalents of both 
what we call the formal side of thought and what we call its content, so 
that one is almost tempted to replace Spearman’s statement by the 
equally extravagant one that there is noting whatever common to all 
mental functions, or to any part of themf.” 

Things were in this very unsatisfactory state when an important 
article by Professor Spearman, in cooperation with Dr Bernard Hart, 
appeared in 1912 In this article the difficulty of making an unbiassed 
judgment as to the presence or absence of hierarchical order was recog- 
nised, and a form of calculation was given for obtaining a numerical 
criterion of the degree of perfection of hierarchical order, which criterion 
would be independent of any bias on the part of the calculator and would, 
it was hoped, give the true amount of hierarchical order, corrected for 
the samphng errors of experiment. This criterion ranges theoretically 
from zero, for absence of hierarchical order, to umty, for perfection of 
hierarchical order. But their formula can, arithmetically, exceed unity. 

* C Spearman, Amer Journ Psychyl xv p 284 f Oy cit p 368. 

$ “General Ability, its Existence and Nature,” by B. Hart and 0 Spearman, Bnt. 
Journ, Psychol, 1912, v pp 51 — ^84 

Note, 1924 Erom correspondence and conversation we gather that the criterion for 
hierarchical order discussed m the next few pages has now been abandoned m practice by 
Professor Spearman who prefers to employ the exact criterion given on p 165 at the foot, 
which he origmally commumcated to Burt for his paper m Brit, Journ Psychol 1910, 
m. p. 159 Though Spearman has not yet as far as we are aware published any survey 
of correlation coefficients by this method to replace his survey (with Hart) by the column 
correlation method, his paper with Holzmger on the probable error of the new criterion is 
an important step towards makmg such a survey possible. See p 192 ei sey. 
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(4) A CRITERION FOR HIERARCHICAL ORDER 

The underlying idea was that if the above square table ^ of correlation 
coefidcients shows hierarchical order in any degree, there will be corre- 
lation between the columns of that table taken m pairs, and that when 
the hierarchical order is perfect the columnar correlation R will rise to 
unity, except in so far as it is blurred by the sampling errors, which 
obviously cannot increase an already perfect correlation, but can only 
decrease it Let us write dashed letters throughout for the true values 
of the various quantities, which m ordinary experiment are unknown, 
reserving undashed letters for their measured values. We then have. 

/ == true correlation coefi&cient, 
e = its samphng error on one occasion, so that 
r = / -f e, 

/ = mean of the column of true values 
r = mean of the column of observed values r. 

In finding these means, that coefficient is omitted which has no partner 
m the column with which correlation is being found. Write also 
p' = r' measured from the mean of the true column, i.e. 

= r' — r\ and similarly 

p = T measured from the mean of the observed column, i.e. 

= r — f, 


€ = p-p', = e-e, 

where e is the mean of the column of c’s. 

Then for two columns a and b, the true columnar correlation which 
we desire to know is 

p ' ^ ^ fi) 

by the Bravais-Pearson product-moment formula, S indicating summa- 
tion over the various values of a;, i e. summation up the column. Tais 


can be written 




V{S{p. 


^ {PxaPxh} " 
” ^{^xa^xa) * 


' S ^ ^ ipxb ^ra) ^ (P j a 

■ {pxa ^xa)i V {^{pxJ)Prb) 


In this expression, the three quantities of the form S (pp) are known. 
The three quantities of the form S (ee) are not known, but an attempt 
can be made to estimate their probable values from the known standard 
deviations of the correlation coefficients. The four quantities of the 


* p. 165. 
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form S (p'e) are treated by Dr Hart and Professor Spearman, m their 
paper, as negligible, on the ground that p will not in general be correlated 
with This assumption we suggest was erroneous. 

The formula at which Dr Hart and Professor Spearman eventually 
arrive, after neglecting these quantities and making various other 
assumptions, is 

where the cr’s are standard deviations of the correlation coefficients, the 
bar indicates mean values for the column, and n is the number of 
pairs of correlation coefficients concerned, in the two columns. In using 
their formula, its authors do not apply it to all the pairs of columns 
in the square table. They say: ‘‘In any case the correction must be 
kept within hmits as usual, the larger the correction the less it is to be 
trusted. If the samphng errors are large enough, they eventually will 
quite swamp the true differences of magmtude upon which the observed 
correlation should be based. In this case, the true correlation is beyond 
ascertainment; any attempt at correction is merely illusory. To avoid 
this, and at the same time to ensure impartial treatment of all data, 
it is necessary to fix beforehand some definite hmit to the feasibihty of 
correction. We have here adopted the following standard, in order to 
attempt to estimate the correct correlation between columns, it is 
required that in each of these columns the mean square deviation should he 
at least double the correction to he applied to that deviation^ 

That is to say, the equation (2) is not to be used unless, in each factor 
of the denominator, S (p^) is at least double its correction (n — 1) 
This condition (the “correctional standard”) will be found to be im- 
portant. 

The authors apphed their criterion to all the experimental work 
available, work dating from various periods, and representing the re- 
searches of 14 experimenters on 1463 men, women, boys and girls. 
From beginning to end the values of the criterion were positive and very 
high. The mean was almost complete unity. That is to say, Dr Hart 
and Professor Spearman claimed that all the data then available showed 
perfect hierarchical order among the correlation coefficients, even the 
data of workers hke Dr Brown and Professor Thorndike, who had been 
unable to detect any such order. The reasons why the hierarchical order 
among the correlation coefficients was not obvious at a glance were, 
according to these authors, two. In the first place, their theory did not 
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entirely deny the presence of Group Factors of narrow range, and tests 
which were too similar were, according to them, to be pooled, before the 
hierarchical order would become apparent Only in very few cases however 
did they find it necessary to pool tests in the data used In the second 
place, the obscuring of the perfect hierarchical order was, according to 
them, due to the fact that only a small sample of sub] ects is examined F or 
this error allowance is made in the formula for calculating their criterion 

Dr Hart and Professor Spearman therefore considered their “ Theory 
of Two Factors” proved This theory considers ability in any activity 
to be due to two factors One of these is a General Factor, common to 
all performances The other is a Specific Factor, unique to that par- 
ticular performance, or at any rate extending only over a very naiiow 
range including only other very similar performances ‘‘It is not 
asserted,” they say, “that the General Factor prevails exclusively m 
the case of performances too alike, but only that when this likeness is 
diminished, or when the resembhng performances are pooled together, 
a point IS soon reached where the correlations are still of considerable 
magnitude, but now indicate no common factor except the General one ” 

In the same paper Dr Hart and Professor Spearman consider, and in 
their opinion confute, two other theories, (a) the older view of Professor 
Thorndike, viz a general independence of all correlations, and (6) Pro- 
fessor Thorndike’s newer view of “levels,” or the almost universal belief 
in “types.” If the former were true, their criterion would, they consider, 
show an average value of about zero if the latter, a low minus value. 

Their argument runs as follows. 

If none but quite Specific Factors are present, the correlations will 
all be zero, and the pairs of columns will show no correlation with one 
another. If however correlations exist, but are due to Group Factors 
alone, then tests which share a Group Factor will correlate highly, but 
others will not correlate at all Let there be three such Group Factors, 
then we shall obtain not a hierarchy but an arrangement hke this: 
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See BnL 

Jmrn Psychol 1912, v. p. 57. 
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in wliicli tlie high correlations are concentrated along the diagonal. In 
this arrangement some columns will correlate positively, namely those 
in which the high correlations come opposite one another, but these 
will be in the minority and most pairs of columns will correlate negatively. 
Professor Spearman and Dr Hart conclude therefore that in the absence 
of a General Factor the average correlation between columns will be 
either zero or negative, and that only a General Factor will give a very 
high positive correlation between pairs of columns. 

In this consideration of Group Factors however it has been tacitly 
assumed that there is no overlapping of such factors. If this were so 
then indeed a hierarchy would be impossible But it is at any rate a 
conceivable hypothesis that such overlapping should occur, that for 
example there might exist a factor common to three tests a, 5, e and 
another common to c, d, e, so that c contains both factors and on this 
hypothesis an excellent hierarchy can be obtained without any General 
Factor, and the average column correlation can even approach unity, 
as we shall show presently, 

(5) COMPLICATIONS IN THE ORIGINAL THEORY 

Many experimental researches were inspired by this paper of Dr Hart 
and Professor Spearman, of which, as a good example, may be cited 
one m 1913 by Mr Stanley Wyatt*. It is not too much to say that 
in practically all of these the apphcation of the Hart and Spearman 
criterion gave values closely approximating to unity and therefore sup- 
porting the Theory of General Abihty. But comphcations began to 
arise, of which the first of importance will be found in Dr Edward Webb’s 
monograph on ‘'Character and Intelligence,” in 1915t Dr Webb con- 
sidered that he had found (m addition to Professor Spearman’s General 
Abihty) a second general factor, which he calls “persistence of motives.” 
Other writers began to find that their data reqmred for their explanation 
large Group Factors, of wider range than those contemplated in the 
original form of Professor Spearman’s theory^. Quite recently Mr J. C. 
Maxwell Garnett, discussing the data of a number of workers with the 
aid of mathematical devices which he has introduced for the purpose, 

^ Stanley Wyatt, “The Quantitative Investigation of Higher Mental Processes,” « 
Bnt Joum Psychol 1913, vi pp 109 — 133. 

t E Wehb, “Character and Intelligence,” Brit Journ, Psychol ^ Monog. 8ujppUme?it, 
1915, No. 3, pp, IX and 99 

f See especially N Carey, “Factors m the Mental Processes of School Children,” 
Brit Joum. Psychol 1916, Tin pp 170 — 182. 
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concludes tLat in addition to the single general factor of Professor 
Spearman, there are two large Group Factors which are practically 
general"^ (one of them being indeed almost identical with Dr Webb’s 
second general factor), which he calls respectively ‘^Cleverness” and 
“Purpose,” both distinct from General Ability. 

It IS clear therefore that in any case the simple original form of 
Professor Spearman’s theory is becoming complicated by additions 
which tend to modify it very considerably. Meanwhile, however, one 
of us had come definitely to the conclusion that the mathematical 
foundations upon which it was based were in fact incoriect. Before 
developing the line of argument which led to this, it will be well to re- 
state Professor Spearman’s case in its simplest terms in a few words 

It IS entirely based upon the observation and measurement of hierarchical 
order among correlation coefficients It states that after allotvance has been 
made for sampling errors this hierarchical order is found practically in 
perfection. And it finally states that such a high degree of perfection can 
only be produced by a General Factor ^ and the absence of Group Factors, 
which would mar the perfection. 

* J. C Maxwell Garnett, “General Ability, Cleverness, and Purpose,” Bnt Journ 
Psychol 1919, rs pp 345—366. 

Note, 1924 There is not space, m a reprint m which only minor alterations are possible, 
to refer to several points which have since been raised concerning the theories discussed in 
this and the following chapter But we may perhaps be permitted to say three things 
concerning a paper of Dr Spearman’s m Bnt J own Psychol 1922, xm p In the rst 
place, that paper gives a proof of what Thomson has always said, that a general factor 
IS ft possible but not a necessary explanation of the correlational facts And secondly. 
Dr Spearman does not perhaps represent Thomson’s position completely, as TCe think 
anyone mil agree who first reads Spearman’s paragraph at the top of his page 30, and then 
reads pages 175, 176, 177 of this hook, pubUshed a year before he wrote, and indeed 
ongmally in Proc Boy Soc 1919 The pomt of agreement which Dr Spearman stresses in 
his last paragraph howeyer we are glad to welcome. 



CHAPTER X* 

A SAMPLING THEORY OP ABILITY 

The case against the validity of Professor Spearman’s argument — Haerarchical 
order produced by random overlap of group factors, without any general factor — 
Apphcation of the “criterion” to these cases, apparently proving the presence of 
a general factor — ^The erroneous nature of the “criterion” — ^Hierarchical order the 
natural order among correlation coefficients — samphng theory of abihty — Transfer 
of traimng — Conclusions 

(1) THE CASE AGAINST THE VALIDITY OF PROFESSOH SPEARMAN’S 

ARGUMENT 

As we have already seen m previous chapters, it is possible, by means 
of dice throws or m other ways, to make artificial experiments on 
correlation, with the immense advantage that the machinery producing 
the correlation is known, and that therefore conclusions based upon the 
correlation coefficients can be confronted with the facts. Working on 
these lines, one of usf made, in 1914, a set of imitation mental tests” 
(really dice throws of a complicated kind), which were known to contain 
no General Factor. The correlations were produced by a number of 
Group Factors which were of wide range, and, unhke Professor Spearman’s 
Specific or Narrow Group Factors, they were not mutually exclusive. 

These imitation mental tests, contaimng no General Factor, gave 
however a set of correlation coefficients in excellent hierarchical order, 
and the criterion was when calculated found to be umty, so that had 
these correlation coefficients been pubhshed as the result of experimental 
work, they would have been claimed by Professor Spearman as proving 
the presence of a General Factor. In a short reply Professor Spearman 
laid stress on the fact that this arrangement of Group Factors which 
thus produced practically perfect hierarchical order was not a random 
arrangement, that it was exceedingly improbable that this one special 
arrangement should have occurred in each of the psychological researches 
of many experimenters, so improbable indeed as to be ruled entirely 
out of court|, and that a random arrangement of Group Factors, though 

* Much, of tins chapter, and part of the preceding, consists of extracts from “Geneiul 
versus Group Factors in Mental Activities,” by G, H Thomson, Psychol, Peview, 1920, 
xsvn. p. 173. 

f Godfrey H. Thomson, “A Hierarchy without a General Factor,” JBrtt, Joum, 
Psychol 1916, vcn pp. 271 — ^281. 

J O Spearman, “Some Comments on Mr Thomson’s Paper,” BriiL Jour7i» Psychol, 
1916, vm. p. 282. 
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it miglit give some hierarchical order, would not give it in the perfection 
actually found The obvious way to find out if this is so or not is to try %t, 
with artificial ‘^mental tests’’ formed of dice throws This was done in 
November and December of 1918, after an unavoidable delay of some 
years Sets of artificial variables (analogous to the scores in mental 
tests) were made, m each of which the arrangement of Group Factors 
was decided by the chance draws of cards from a pack’^. It was found 
that hierarchical order resulted, which when measured by the ‘‘ criterion ” 
appeared to be perfect. 


(2) HIERARCHICAL ORDER PRODUCED BY RANDOM 0\TSRLAP OF 
GROUP FACTORS, WITHOUT ANY GENERAL FACTORf 

Write down the letters as the names of the variates to 

be formed, and prepare columns to receive the numbers of group factors 
and specific factors in each variate Determine each number by the 
draw of a card from an ordinary playing pack, returning the card and 
shuffling between each draw, the knave, queen, and king may be counted 
11, 12, and 13 respectively. The result of one such set of drawings is 
shown in this table: 


Variate 


Group factors 


Specific factors 


Total 




5 

5 

12 

1 

7 

9 

13 

1 

9 

11 


I 


5 
3 

12 

3 

6 
5 

13 

2 

3 

5 


10 

8 

24 

4 

13 

14 
26 

3 

12 

16 


Proceed next to identify the group factors of each variate. Do this 
by using a single suit of the pack. After shulBSing it well, lay out the 
top five cards to represent the five group factors in and note them. 

* Godfrey H. Thomson, “On the Cause of Hierarchical Order among the Correlation 
Coefficients of a Number of Variates taken m Pairs,” Proceed%7igs of tht Moyal Society of 
London, 1919, xcv. A, pp 400 — i08. See also, by the same author, “The Hierarchy of 
Abilities,” and “The Proof or Disproof of the Eiostence of General Abihty,” in Bf%i, 
Joum. Paychol, 1919, ix pp. 321 — 344 

t Tbifl section and also section 5 consists largely of extracts from the Froc. Moy. Soc, 
1919, xov. A PP‘ ^90 — i08. 
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After replacing them and reshuffling, do the same for ccg, and so on, as 
in this table; 



Ace 

2 

3 

4 

5 

6 

7 

8 

9 

10 

Kn 

Q 

K 


/ 

/ 



/ 


/ 


y 




I 

X 2 





/ 


/ 

y 

y 


/ 

X 3 

/ 

/ 

y 

/ 

/ 


/ 

y 

y 

y 

y 

y 








/ 





y 

Xs 

/ 

/ 



/ 


y 




y 

/ 

Xe 




/ 

/ 

/ 

/ 

y 

y 

y 

y 

y 


/ 

/ 

/ 

/ 

/ 

/ 

/ 

y 

y 

y 

y 

y 

y 

X 3 


/ 












X 3 

/ 

/ 

/ 

/ 

/ 

/ 

/ 

y 





y 

^10 

/ 

/ 

/ 

/ 

/ 

/ 

/ 


y 

y 

1 

/ 


The next step is to note the number of factors common to each pair of 
variates, as in this table 




2^3 

iKs 

Xe 

CCg 

aJs 

a^io 


2 

5 

0 

5 

2 

5 

1 

5 

4 


x^ x^ 


2 6 

5 

5 — 

1 1 

3 7 

6 8 

5 12 

0 1 

2 8 

4 10 


354 ^ 


0 5 2 5 

13 5 5 

1 7 8 12 

-111 
1—47 
14—9 
17 9 — 

0 10 1 

0 6 5 9 

1 6 8 11 


Us Xq XiQ 


16 4 

0 2 4 

1 8 10 

0 0 1 

1 5 6 

0 5 8 

1 9 11 

- 1 1 

1—8 
1 8 — 


From these, and from the total number of factors both specific and group 
in each variate, can be found the correlation which would occur between 
the variates were we to throw dice, one to each factor, and repeat the 
throwings a large number of times. The formula is 

Number of common factors 
Geometrical mean of totals* 

This formula is apphcable not only to variates formed by the addition 
of dice, but to variates which are any function of the factors or elements, 
provided that the form of the function is the same in each variate, and 
that the standard deviation is the same for each element or factor"^. 
We thus obtain the following table of theoretical correlation coeffi- 
cients: 

* Q, H. Tkomson, he. cit p. 275. It can readily be deduced from Bravais, M^motres 
de VlTnaiitut de France, 1846, ix. 28. 
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2^2 

Xg 

X4, 



aijr 

% 

^9 

*^10 

Totals 

X-i 



0 22 

0 32 

0 00 

044 

0 17 

0 31 

0 18 

0 46 

0 32 

2 42 


0 22 

— 

0 39 

0 18 

0 29 

0 47 

0 35 

0 00 

0 20 

0 35 

2 45 

% 

0 32 

0 39 



010 

0 39 

0 44 

0 48 

0 12 

0 47 

0 51 

3 22 


0 00 

018 

010 



0 14 

0 13 

010 

0 00 

0 00 

012 

0 77 

^5 

0 44 

0 29 

0 39 

0 14 

— 

0 30 

0 38 

0 16 

0 40 

0 41 

2 91 

Xq 

0 17 

0 47 

044 

0 13 

0 30 

— 

0 47 

0 00 

0 38 

0 53 

2 89 

x^ 

0 31 

0 35 

0 48 

0 10 

0 38 

0 47 

— 

on 

0 51 

0 54 

3 25 

Xg 

0 18 

0 00 

012 

0 00 

016 

0 00 

on 

— 

0 17 

015 

oso 

2. 9 

0 46 

0 20 

0 47 

0 00 

0 40 

0 38 

0 51 

0 17 

— 

0 58 

3 17 

aJio 

0 32 

0 35 

0 51 

0 12 

0 41 

0 53 

0 54 

015 

0 58 

— 

3 51 


If we wished to obtain experimental values of these, dice w^ouid have 
to be thrown, one to each factor The die corresponding to the group 
factor called “Ace’’ would have its score couiited into every variate 
containing the group factor in question The dice representing the 
specific factors would, of course, only be counted into the one variate 
in which they occur. 

The last column of the preceding table gives the total correlation of 
each vanate with all the others, found by adding the row^s of the square 
table Rearrange now the sequence of the variates in the order of 
magnitude of these totals*, and 'we obtain the following table 


1 


>^3 


Xy 



X2 

Xi 

2^8 




0 51 

0 58 

054 

0 41 

0 53 

0 35 

0 32 

0 15 

0 12 

®10 

0 51 


0 47 

0 48 

0 39 

0 44 

0 39 

0 32 

0 12 

0 10 


0 58 

0 47 


0 51 

0 40 

0 38 

0 20 

0 40 

017 

0 00 


0 54 

0 48 

0 51 



0 38 

0 47 

0 35 

0 31 

on 

0 10 

^7 

0 41 

0 39 

0 40 

0 38 

— 

0 30 

0 29 

044 

016 

0 14 


0 53 

044 

0 38 

0 47 

0 30 

— 

0 47 

0 17 

0 00 

0 13 


0 35 

0 39 

0 20 

0 35 

0 29 

0 47 

— 

0 22 

0 00 

0 18 


0 32 

0 32 

0 46 

0 31 

0 44 

017 

0 22 

— 

0 18 

0 00 


0 15 

012 

017 

on 

016 

000 

0 00 

0 18 

— 

0 00 

•4/g 

012 

010 

0 00 

010 

014 

0 13 

018 

0 00 

0 00 



Here the tendency to hierarchical order is quite noticeable. This par- 
ticular example is purposely chosen fiom among a number calculated, 
as being that which shows the least hierarchical tendency Even here 
however there is clearly a general lowering of the coefficients as we 
pass either along a row or down a column The columnar correlation 
IS high for the first few columns For the columns headed 
0*97, and as far down as the columns headed and Xq it is still 0'G5. If 
these theoretical numbers were blurred by experimental error, they might 
well be claimed as having come from a perfect hierarchy by the criteria 
in vogue. Other hierarchies chosen at random from those formed m 
the above manner, show still more perfect hierarchical order, and some- 
♦ A convenient p.an, but of no theoretical fligniicance. 


B. &T 


12 
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times the hierarcliical order is almost quite perfect, as in the example 
given in the BnUsh Journal of Psychology, 1919, ix. p 343 


(3) APPLICATION OF THE “CRITERION” TO THESE CASES, APPARENTLY 
PROVING THE PRESENCE OF A GENERAL FACTOR 

The values of the correlation coefl&cients given in the above table 
are of course the real values To obtain experimental values of these, 
dice were thrown, one die to each Group or Specific Factor, and the 
whole repeated 30 times, analogous to experiments on 30 subjects* 
From the dice scores the observed correlations between the variates 
can be calculated Using the product-moment formula we obtain the 
set of values in this table 


The Observed Hierarchy 



^10 


3^9 



CTi 







66 

61 

71 

69 

45 

52 

37 

24 

- 07 


66 

— 

67 

57 

52 

45 

36 

33 

25 

19 


61 

67 

— 

49 

58 

58 

•40 

28 

•10 

03 


71 

•57 

49 

— 

57 

28 

42 

58 

- 01 

01 

^7 

•69 

52 

58 

57 

— 

•33 

58 

43 

- 11 

02 


45 

45 

58 

28 

•33 

— 

59 

23 

27 

- 06 

^3 

52 

36 

40 

42 

58 

59 

— 

23 

- 14 

05 


•37 

33 

28 

58 

•43 

23 

23 

— 

04 

- 14 


•24 

25 

10 

- 01 

- 11 

•27 

-•14 

04 

— 

- 10 


- 07 

19 

03 

01 

02 

- 06 

05 

- 14 

- 10 

— 


The pairs of columns which pass the Hart and Spearman correctional 
standard give the following values : 


Columns passing 
standard 

Observed columnar 
correlation B 

True columnar 
correlation 

The Hart and Spearman 
corrected columnar 
correlation B' 

3 and 6 

0 72 

0 88 

0 87 

3 

„ 7 

0 83 

0 99 

0 98 

3 

» 9 

0 89 

0 87 

1 14 

3 

„ 10 

0 73 

0 98 

0 85 

6 

» 7 

0 94 

0 88 

108 

6 

» 9 

0 78 

0 62 

0 92 

6 

» 10 

0 83 

0 83 

0 90 

7 

„ 9 

0 81 

0 86 

0 93 

7 

»10 

0 84 

0 99 

0 91 

9 

„10 

0-89 

0 84 

104 

Means 

0-83 

0-87 

0*96 


True mean columnar correlation of the whole table and not me 
of the pairs of columns selected by the correctional standard 



* G. H Thomson, BiometnJca, 1919, xn. pp. 355 — 366, where the full details of the 
dice throws are given, corrected and contmued in 1923, xv. pp. 150 — 160. Another example 
IS also given there Sections 3 and 4 of the present chapter consist largely of extracts 
from Biomeinha, where the diagrams 28 and 29 appeared. 




A SAMPLING THEORY OP ABILITY 


179 


CH. X] 

Dr Hart and Professor Spearman would therefore claim the hierarchy 
as being a sample of a perfect one The true mean columnar correlation 
for the whole table is 0*59, the Hart and Spearman correctional standard 
selects pairs of columns whose true mean columnar correlation is 0*87, 
and the mean value of these when corrected according to their formula 
rises to 0 96 This example goes far towards shaking confidence in 
their criterion. 


(4) THE ERRONEOUS NATURE OF THE HART AND 
SPEARMAN CRITERION’^ 

The inaccurate and exaggerated estimates of hierarchical order which 
are given by this ‘‘criterion” arise chiefly from two causes, (1) the 
erroneous assumption that p' and e are uncorrelated (see p 170), and 
(2) the action of the “correctional standard ” We shall consider these 
in turn. 

Consider the formula for the standard deviation of a correlation 
coefficient, viz. 

where N is the number m the sample. It follows from this that the 
larger correlation coefficients will probably have the smaller samphng 
errors e, disregarding the sign of e for the moment 

But these signs of the quantities e are not hkely to be indiscriminately 
positive and negative. On the contrary, they will have a tendency to 
be either all positive or all negative, if, as is the case in most of the 
columns of coefficients considered by Professor Spearman, the corre- 
lations in the square table are mainly positive. The errors in the corre- 
lation of a variate with a variate a are themselves correlated with 
the errors in the correlation of the variate a with another variate 
according to the formula' 

^xia'^x->a (1 ^ 

■ 2 (1 - r ,/) (1 - 

That IS, the correlation of the samphng errors of *1^® samphng 

errors of depends chiefly upon To illustrate, let us take three 

* See note on p 192. 

t Karl Pearson and L N G Filon, “ On the Probable Errors of Frequency Constants," 
Phi Tram of the Boyal Boc. 189S, cxci A, eqn 37. 
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correlations from an experiment in psychology, carried out by Mr Wyatt*. 
If we let 

be the mental test “Rearranged Letters,’’ 

X2 „ „ 5, “Missing Digits,” 

a „ „ 5, “Analogies,” 

the values there found were 

= 0 - 61 . 

Then by the above formula the correlation of the errors of these two 
coefficients depends chiefly upon whose measured value is 0 * 63 . 
Using the full formula, and employing the measured values in default 
of the true ones, the correlation between ^0:20 turns out to be * 47 . 

It IS therefore (to an extent indicated by this value) probable that they 
are either both too large or both too small The same argument holds, 
in varying degrees, for the other correlations all over Mr Wyatt’s table^ 
which are all positive They all have a tendency to be either all too 
large or all too small, in other words, the e’s tend to be all of the same 
sign. The relationship between the correlation coefficients of a column, 
and their errors, can therefore be summed up in the following table, 
m which the symbol | e | denotes the magnitude of e regardless of sign. 


r' 

i«i 

P' 

e 

or e 

p'e or p'e 

large 

small 

+ 

— 


+ 

\ / 

A 


- 

+ 



\ 

+ 

- 

+ 

— 4 . 



~ 

- 

+ 





+ 

- 

“ + 

V 

/ \ 

— 


- 

+ 

small 

large 

““ 

+ 

— 



1 


S{pU)= 

~ or + 


The first column shows the true correlations / arranged m order of 
magnitude. The second column expresses the fact that the samphng 
errors on any occasion will probably be arranged in the reverse order of 
magnitude, disregarding their signs. The third column shows the corre- 
lation coefficients measured from their mean. The upper p”s are then 
positive, and the lower negative, and also, what is not shown m the 

* Stanley Wyatt, “The Quantitative Investigation of Higher Mental Processes,**^ 

£rit Journ* Fsychol 1013, vi. p 131 
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table, the absolute values increase upwards and downwards from the 
point where the signs change The fourth (double) column shows the 
probable arrangement of the signs of the quantities e If the e's are all 
tending to be positive, then the left-hand 
member of the double column gives the 
arrangement, while if the e’s all tend to be 
negative, the other member of the double 
column does so As shown in the last (double) 
column, therefore, the quantities pe tend 
either to be nearly all negative or nearly all 
positive. For a very small sample the signs 
of pe will no doubt be quite irregularly 
arranged. But with such a small sample, 
even if p and e were really uncorrelated, it 
would be most unlikely for S (p'e) to be 
neghgible As the sample increases the signs 
tend to settle down to the above arrange- 
ment, and S (p'e) does not tend to disappear 
compared with S (ce), but only to take on 
one or other of alternative values. It will 
only be zero when all the errors are zero, 
i.e. when 7 io corrections are needed to R\ 

The distribution of S (p'e) about zero m a 
number of samples of the same size will not, 
that IS, show a maximum at zero, but a 
mimmum, as is shown quahtatively m Fig. 28. 

If, in fact, the actual value of S (pe) is 
calculated in cases where the true correla- 
tions are known, it is frequently found to be 
greater than the quantities S (ec) which are 
left in the expression. 

The other approximations made in obtain- 
ing the criterion do not appear to be so 
erroneous as this one, though their cumulative 
effect may explain some anomahes. Leaving 
them on one side let us consider the “cor- 
rectional standard” required by Dr Hart and ^ t • i 

Professor Spearman before they admit any pair of columns. It is this 
correctional standard, combined with the pecuhar distribution of B, 
which chiefly is responsible for the exaggeration of perfection produced 
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by this criterion, and for the regularity with which an average value of 
unity IS arrived at. 

Let us examine first the actual distribution of the Hart and Spearman 
R ' m a psychological hierarchy, viz. that of Wyatt already referred to, 
and calculate J?' not only for those columns which pass the correctional 
standard, but also for other pairs of columns What we find is that its 
value rises as we descend the hierarchy, rushing asymptotically to 
infinity, remaining for a time imaginary, and then returning Specimen 
values from Mr Wyatt’s hierarchy are given. 

Pairs of columns Values of the Hart and Spearman Criterion 

Analogies and Wordbuildmg .. ... 0 93-\ 

Completion and Wordbnilding 0 97 

Completion and Part-wholes 1 05 ^ Passed by the correctional standard 

Wordbuildmg and Part-wholes . . 0 99 

Part-wholes and Memory (delayed) . 0 92. 

Rearranged letters and Missmg digits , . 1 17 

Wordbuildmg and E R Test . 1 26 

Sentence constiuction and Fables . . 1 33 

Rearranged letters and E R Test . Practically infimty 

Nonsense syllables and dissected pictures Imagmary 

Crosshne test and Letter Squares 0 35, a meaningless value, both factors in the 

denommator being now negative 

Expressed in diagrammatic form this and similar calculations lead 
to the conclusion that in actual practice the criterion is distributed as 
in Fig. 29, where the curve is to be understood as a “best fitting” curve 
among the values of R' scattered, with a very considerable dispersion, 
on both sides of it. The line, in fact, ought to be a broad smudge. 

Now clearly, with a distribution of this sort, it is very important 
that the boundary between the values that are to be rejected and those 
that are to be accepted should be chosen with the greatest care, and not 
arbitrarily but scientifically. Either sound theoretical reasons should 
be given for the choice of the correctional standard, or the choice should 
be based empirically on experiments in material where the truth is 
known a pnon, as in the above dice experiments. For obviously, by 
moving this boundary, we can make the final average take on almost 
any value. Another point is that the criterion rushes to infinity at such 
speed that its probable error must be enormous. Dr Hart and Professor 
Spearman, however, give no reasons for their choice of this particular 
standard, upon which depends so much the values they obtain. The 
standard which they thus arbitranly adopt begins admitting the criteria 
at just such a distance above unity as to balance the cases which give a 
criterion below unity, and entirely explains the remarkable unanimity with 
which this average value unity is obtained by them in their calculations. 



CH. X] 


A SAMPLING THEORY OF ABILITY 


183 


In other words, the remarkable regnlanty with which this criterion 
gives the value unity is not a property of the investigated correlation 
coefficients at all, but is a property possessed by the criterion itself, due 
to errors and the action of the ‘‘correctional standard.’’ 



Pig 29 

In the writers’ opinion the work outlined in this chapter finally 
proves the invahdity of Professor Spearman’s mathematical argument 
m favour of the Theory of Two Factors If this be so that theory returns 
to the status of a possible, but unproven, theory. 

(5) HIERAECHICAL ORDER THE NATURAL ORDER AMONG 
CORRELATION COEFFICIENTS 

The fact is that hierarchical order, which Professor Spearman was 
the first to notice among correlation coefficients, is the natural relation- 
ship among these coefficients, on any theory whatever of the cause of 
the correlations, excepting only theories specially designed to prevent 
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its occurrence. It is the absence of hierarchical order which would be 
a remarkable phenomenon requiring special explanation, its presence 
requires none beyond what is termed chance. 

An analogy from the simple repeated measurements of a hnear 
magnitude may help to illustrate this Indeed it is rather more than an 
analogy, being in fact the same phenomenon in its simplest terms and 
dimensions It is well known that many measurements of the same 
quantity, made with all scientific precautions, under apparently the 
same conditions, and with an avoidance of all known sources of error, 
nevertheless do not give a number of identical values. The values are 
all difierent, but are not without law and order in their arrangement 
They are grouped about a centre from which the density decreases m 
both directions, and it is found that this grouping is for most practical 
purposes closely represented by the Normal or Gaussian Curve of Error 
(or one of the more general Pearsonian Curves) 

Experimenters are not surprised to find their data obeying the 
Probabihty Law, nor do they require a special theory to explain it. 
On the contrary, it is the departures from this Law which if wide would 
reqmre special investigation, and if confirmed would require a special 
theory. In the same way hierarchical order among correlation coeffi- 
cients should not cause surprise, though any marked variation from this 
order would demand investigation. 

Measured correlation coefficients are themselves correlated, and n 
coefficients form an ^i^-fold or ^^-dlmenslo^al correlation-surface. The 
particular and convenient form of tabulation of correlation coefficients 
adopted by Professor Spearman and followed by most other psycho- 
logical workers brings to hght, in the form of ‘'hierarchical order,’’ one 
of the properties of this correlation-surface of the correlations. 

In an article entitled “On the Probable Errors of Frequency Con- 
stants and on the Influence of Eandom Selection on Variation and 
Correlation,” in the Phil. Trans, 1898, cxci. A, pp 229 — 311, Professor 
Pearson and Mr Filon give the following formulae. 


^23 


^12^13 d- ^^12^23^31 ^ “ 

2(l^r,,^) (l~r,3^) 




f(^i 3 - ^ 12 %) (% “ ^23^34) + (ri 4 - ) 

1+ (^13 " ^14^43) (% - ^21^14) + (hi - ^12%) (% - ^24^43)) 


so that, as they say, “errors in the correlations of a first organ with a 
second and a third have a correlation themselves of the first order,” 
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and “errors in the correlation of two organs and in the correlation of 
a second two have only correlation of the second order ” 

Suppose now that the correlations among a number of variates taken 
in pairs are really all the same, and positive, and in a sample let the 
observed value of rgg be the highest observed value 



Xg 

Xg Xg Xj 

378 

. . . 


h 

t 

h 


X 2 
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fljg h) Jh 

— 

h h H 2 h 

Hi 

/i . . . 


h 


h 



7i 


h 


iCa 

Eg 

— 

Eg 



Ji 


h 

1 

I 

Xg h ft 

l 

h h Eg h 

' — 

h , . . 


h i 


i h 


■^0 

• ' 

: 

• 


■ 

• 


• 



highest correlation second highest, and so on tendency to be Ingh. 

Then, because of the above theorems of Pearson and Filon, the rows 
and columns and will probably contain more total correlation than 
do the others, and the second highest coirelation will probably be in 
one of these Let it be Then, after the rows Xq and Xg the low Xg 
will probably contain many high correlations and rgg will probably be 
the third highest coefficient, because it is a node where two ndges of 
high correlation cross. If it is, then the hierarchy so far is excellent, as 
can be seen on rearranging the square table so as to bnng Xg, Xg, and 
to the head*. 

Where now is the fourth highest r likely to be founds Somewhere 
among those marked h for high, and shghtly more probably among the 
r’s of the row Xg. If to avoid further rearranging we take it to be 
then Tgi IS most probably the fifth, and the sixth, because they are 
nodes. And so on. In fact it is clear that when the r’s are really equal 


* See next page. 
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to one another, then sampling the population will give a set ot observed 
r’s which are arranged not in haphazard, but in hierarchical order. 





Xq 
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In the experiment described above with cards and dice, where 
hierarchical tendency was found to be produced by group and specific 
factors without any general factor, there was, however, no question of 
sampling the population. The hierarchical order already appears in the 
theoretical coefficients. There is here, however, another kind of sampling 
present, viz. samphng of the elements which make up the vanates. 

Let us suppose, instead of deciding the numbers of groups and specific 
elements as we did by drawing cards, we had dipped into an infimte bag 
contaimng black balls and white balls, the former representing group 
factors and the latter specific factors. Then the most probable event 
would have been that the proportion of group factors and specific 
factors in each variate would have been the same as the proportion in 
which the balls occurred in the bag If, in addition, we assume the samples 
drawn to be all the same size, then the most probable result of the whole 
experiment would have been obtaimng all the correlations equal. 

That they do not come out equal may be regarded as due to the 
samphng. The samples vary in size, the proportion of group factors 
varies from sample to sample, and the distribution of the individual 
group factors among the several variates departs from the most probable 
ffistnbution. From this point of view the departure of the correlation 
coefficients from equality is due to errors of samphng, and the apphca- 
tion of the theorem of Pearson and Filon would lead us to expect what 
as we have seen does actually occur, namely, hierarchical order. 
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The experiment with the bag of balls would as a matter of fact not 
produce as great a departure from equality of correlation coefficients 
as IS found in practice in experimental psychology, or as was found in 
our form of the experiment with card drawing This m the latter case 
IS because the cards give a greater variation of the proportion of group 
to specific factors than would be found with the bag of balls. And this 
IS also the case in mental tests, which are not chance samples of the 
mental elements, but are carefully chosen so as to measure different 
kinds of activity. 

This apphcation of Pearson and Ellon’s theorem (which contemplates 
only samphng errors in the ordinary sense) to the changes m correlation 
produced by sampling the underlying elements, is no doubt somewhat 
novel, and may appear to be a difficulty. 

Further consideration leads to the following resolution of the 
difficulty*. 

Suppose that n variates (in our work the scores in mental tests) 
are so connected by factois that the correlations are all equal and 
positive Then let a small sample of the population be taken The 
observed correlations will show departures from equality, and will be 
found to be in hierarchical order. This hierarchical order is duo to 
samphng the population 

Now consider why the correlations do not come out at their true 
values. They give of course the true values /or the sample. The reason 
of their departing from the true values of the whole population is that 
(a) some of the factors which really are links between the variates (the 
mental activities) happen to have remained steadier than usual during 
the sample. In the hmit a factor might happen to retain exactly the 
same value through the various individuals of the sample. That is, 
some of the linking factors do not in reahty come into action, or not in 
their full force, (6) on the other hand, some factors which are really 
different and unconnected may happen by chance to rise and fall 
together, through the sample, and more or less to act as one. That is, 
fictitious linking factors are created, which would disappear with a 
larger sample. 

Clearly therefore a hierarchy of correlation coefficients, caused by 
samphng the population, is due to chance havmg caused a change m 
the apparent factors acting. It follows that if we make a real change 
in the factors acting, we shall get a hierarchy, and this is wffiat w^e do 
when we choose the mental tests to be employed in any research* Each 
mental test is a test of a sample of abihties. 

* The following is quoted from p. 182 etaeq of Psychol Review, 1920, xxvn Ko 3. 
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The laws governing the correlation of correlation coefficients which 
vary because of sampling the population can, in fact, be apphed without 
hesitation to the relationships between “true” correlations in the whole 
of any population simply because any such population is itseK a sample. 
Enghsh grammar school boys of 12 are themselves a sample of a larger 
boyhood, the whole human race indeed is a sample of “what might have 
been,” selected by the struggle for survival. 

The whole question clearly has philosophical bearings on the degree 
of reahty of causal connections; for on this view those chance hnks in 
a small sample which were a few paragraphs ago termed “fictitious hnks, 
which would disappear with a larger sample,” do not differ except m 
degree from the “real” causal hnks which we only term real because 
they persist throughout the largest sample with which we are acquainted. 

In another direction there are connections with the difference, which 
is one of degree only, between what is called “partial” correlation and 
“entire” correlation'^. 

The conclusion to be drawn is that hierarchical order is the natural 
order to expect among correlation coefficients, on a theory of chance 
sampling alone, and that therefore, by the principle of Occam’s razor, its 
presencef cannot be made the criterion of the existence of any special form 
of causal connection, such as is assumed m the Theory of Two Factors. 

(6) THOMSON’S SAMPLING THEOEY OF ABILITYt 

In place therefore of the two factors of that theory, one General and 
the other Specific, Thomson prefers to think of a number of factors at play 
in the carrying out of any activity such as a mental test, these factors 
being a sample of all those which the individual has at his command 

The first reason for preferrmg this theory is that of Occam’s razor. 
It makes fewer assumptions than does the more special form of theory 
It does not deny General Ability, for if the samples are large there will 
of course be factors common to all activities On the other hand it does 
not assert General Abihty, for the samples may not be so large as this, 
and no single factor may occur in every activity. If moreover a number 
of factors do run through the whole gamut of activities, forming a 
General Factor, this group need not be the same in every mdividual. 

* See Karl Pearson, “On the Influence of Natural Selection on the Variability and 
Correlation of Organs,” Phil Trans Boy Soc, London, 1902, oo. A, pp 1 — 66, Godfrey 
H, Thonoson, “The Proof or Disproof of the Existence of General Ability,” Bnt Journ 
Psychol, 1919, JX, pp. 321 — 336 

f See ch xi, and meanwhile read “its presence, unless in a degree of perfection greater 
than cbance would explain ” Note added 1924. 

% Psychol, Mevvew, 1920, xxvu. p 183 
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In other words General Ability, if possessed by any individual, need 
not be psychologically of the same nature as any General Abihty 
possessed by another individual Everyone has probably known men 
who were good all round, but Jones may be a good all round man for 
different reasons from those which make Smith good all round. 

The Samphng Theory, then, neither denies nor asserts General 
Abihty, though it says it is unproven. Nor does it deny Specific Factors. 
On the other hand it does deny the absence of Group Factors It is this 
absence of Group Factors which is in truth the crux of Professor 
Spearman’s theory, which is not so much a theory of general ability, 
or a theory of two factors, as a Theory of the Absence of Group Factors 
And inasmuch as its own disciples have begun to require Group Factors 
to explain their data, its distinguishing mark would appear in any case 
to be disappearing 

Such Group Factors as are admitted by Professor Spearman are of 
very narrow range, and are mutually exclusive, that is they do not 
overlap. Both these points follow from the sentence used m the 1912 
article with Dr Hart, where it is said that, in the case of performances 
too ahke, ‘^when this hkeness is diminished, or when the resembling 
performances are pooled together, a point is soon reached where the 
correlations are still of considerable magnitude, but now indicate no 
common factor except the General one.” 

Since this point is soon reached, the Group Factors must be narrow 
in range. Since poohng a few performances will obhterate any Group 
Factors, they must be exclusive of one another. For if A, B, G and D 
are four tests, in which A and B have a Group Factor common to them, 
and C and D another, then of course by pooling A with B and also C 
with D we can obtain two pools AB and CD which have no hnk. But 
ii Ay B and 0 have one Group Factor, and C and D have another, then 
these Group Factors cannot be separated into Specific Factors. In fact, 
a Specific Factor is a separated Group Factor, and Professor Spearman’s 
theory asserts that Group Factors, if any, are separable and mutually 
exclusive This is a great stumbhng-block in the way of the acceptance 
of the Theory of Two Factors, unless perhaps Specific Factor’' m 
interpreted in the way suggested later. 

It is a fact which will be admitted by most that the same activity 
is not performed m the same way by different individuals, even though 
they are equally expert Not only are Specific Factors therefore required 
by this theory for every separate activity, excluding only any which 
are very closely similar, but also Specific Factors of different psycho- 
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logical natures are required for each individual. Further, the same 
individual does not always perform the same activity in the same way. 
A man using an ergograph will, as he tires, begin to employ muscles 
other than those naturally used at the outset. When we are returning 
from a cycle ride muscles are used in a difierent manner from the style 
adopted at the start, indeed sometimes dehberate changes are made to 
give rehef. And in the same way a mental task is performed by 'different 
methods at different times. Does this then mean a different Specific 
Factor for each way of doing a task? All these difficulties appear to 
argue against the Theory of Two Factors, and seem to be considerably 
cleared up by the Samphng Theory. 

Finally, the Samphng Theory appears to be m accordance with a 
line of thought which has already proved fruitful in other sciences. 
Any individual is, on the Mendehan theory, a sample of unit qualities 
derived from his parents, and of these a further sample is apparent 
and explicit in the individual, the balance being dormant but capable 
of contributing to the sample which is to form his child. It seems a 
natural step further to look upon any activity carried out by this indi- 
vidual as involving a further sample of these quahties. 

(7) THE DIFFICULTY OF “TRAISTSFER OF TRAINING” 

Although Professor Spearman’s Theory of Two Factors has been 
chiefly based by him on the hne of argument which, it is suggested, 
has now been proved invahd, viz. the ^‘hierarchy” argument, yet there 
IS another and powerful form of reasoning which can be brought to 
its support, based upon the fact that, according to some experimenters, 
improvement in any activity due to training does not transfer m any 
appreciable amount to any other activity, except to those very similar 
indeed to the trained activity. And even those workers who do not 
agree that this is an experimental fact are usually content to take a 
defensive attitude and say that transfer is not disproved. Few if any 
will say that it is proved. 

This certainly seems to point to the absence of Group Factors, and 
to support Professor Spearman’s theory, which only needs to add to 
itself the assumption that the Specific Factors are, while the General 
Factor is not, capable of being improved by training, to fit the case 
admirably. Of course, if transfer really occurs, the argument proves 
the opposite. And although psychological experiment points on the 
whole to the absence or the narrowness of transfer, yet popular opimon 
among business men, schoolmasters, and others, is in favour of transfer 
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to a considerable extent. Assuming no transfer, however, how can the 
Sampling Theory, with its numerous Group Factors, explain this^ 

It is necessary to assume that the Group Factors are all unim- 
provable ox only shghtly improvable by training, though they may 
change with the growth and development of the individual. The 
improvement which certainly takes place when we practise any activity 
is due, it may then be assumed, not to improvement in the elemental 
abihties which form the sample, but to a weeding out, and selection of 
these The sample alters, mainly no doubt is diminished, though addi- 
tions are also conceivable. It becomes a more economical sample, and 
waste of effort in using elements which are unnecessary is avoided. 
Improvement in any mental activity may on this view be compared 
with improvement in a manual dexterity, in which it is notorious that 
the improvement consists largely m the avoidance of unnecessary 
movements 

When another activity is then attempted, the elemental factors are 
just the same as they would have been had the practice in the first 
activity not taken place. The new activity will be performed by a new 
group of factors, which sample will as m the first case be in the beginning 
wasteful and will include many unnecessary elements. Transfer of 
improvement gained in the first activity will therefore not take place 
except in so far as the second activity is recognised as a mere vaiiant of 
the original one, in which case the weeding out process which has taken 
place in the fiirst case may be done at the very first attempt, at any rate 
to some extent. 

To use another analogy, the improvement which takes place when 
a football team practises playing together for a series of matches is due 
more to team work than to indi^udual improvement. A new team, even 
though it contain a large proportion of players from the first team, will not 
have this unity of action There wull be httle transfer of improvement. 

According to the view here developed, it is the weeding out of the 
sample of elemental abihties which is specific The team work is specific, 
though the players play for several clubs. This would appear to enable 
a reconcikation to be effected between the almost umversal behef m 
‘‘types” of ability (to which Professor Spearman refers) and the experi- 
mental facts concerning both correlation and transfer. If there be a 
General Factor at all, it might be the power to shake down rapidly into 
good team work, in a word, educability. But there seems no objection 
to assuming that this, instead of being a General Factor, is a property 
of each elemental factor, varying from factor to factor 
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To sum up tins section if transfer of training really does not occur 
to any great extent, tlien it has to be admitted that the Theory of Two 
Eactors readily explains this But the Samphng Theory can also do so, 
in a manner which is perhaps not so easy to set forth, but which never- 
theless appears to be more illuminating and less artificial than the 
alternative theory 


(8) CONCLUSIONS 

Professor Spearman’s Theory of Two Factors, which assumes that 
abihty in any performance is due to {a) a General Factor and (&) a Specific 
Factor (Group Factors being absent, or at any rate very narrow m 
range and mutually exclusive), is based chiefly on the observed fact that 
correlation coefficients in psychological tests tend to fall into ^‘^hierar- 
chical order ” It has been shown, however, that the criterion adopted 
for evaluating the degree of perfection of hierarchical order present is 
untrustworthy and has led to over-estimation. Such hierarchical order 
as is actually present is in fact the natural thing to expect, and it is the 
absence of such which should occasion surprise. The proof of the Theory 
of Two Factors which is based on the presence of hierarchical order 
therefore falls to the ground. The theory remains a possible explanation 
of the facts but ceases to be the unique explanation. As an alternative 
theory Thomson has advanced a Samphng Theory of Abihty, in which 
any performance is considered as being carried out by a sample of 
Group Factors This theory is preferred because it makes fewer and less 
special assumptions, because it is more elastic and wider, and because 
it is in closer accord with theories in use m biology and m the study of 
heredity. 

Note, 1924 Mr H G Stead has made the views expressed in pp 179 — 183 the subject 
of experiment {Journ Roy Stat Soc 1923, uxxxvi p 412) and obtams results which do 
not agree with the suggestion that the c’s tend to be of the same sign (p 180) or with the 
suggested distribution of S {p'e) (diagram p 181) As to the first point, it would seem that 
the tendency must be there if Pearson and Mon’s formula is correct (p 179) provided the 
correlations are positive But the tendency will be the less, the smaller the correlations; 
and we understand that many of Mr Stead’s correlations were very small, which possibly 
explains the discrepancy As to the distribution of S (p'e) we think (though he does not 
agree) that Mr Stead has plotted the wrong quantity The diagram on p 181 does not mean 
that a number of values of S (p'e) from different columns of one experiment will have two 
maxima, but that one value of S (p'e), when obtamed many times m many experiments, 
will show that property. 

With the second part of the argument, on pp 182 and 183, Mr Stead’s results and his 
expressed opinions are in complete agreement. 



CHAPTER XI 

THE PRESENT POSITION (1924) 

It appears desirable to utilise the remaining available pages for a state- 
ment of the present position of the controversy which forms the subject 
of the two preceding chapters, especially as in discussion points of 
difference are apt to be magnified and points of agreement lost sight of. 

The term general intelhgence” or “general ability” is liable to have 
two distinct meanings On the one hand it may be a statement of a 
fact, on the other an explanation of that fact The fact which makes 
the term a necessary and a useful one is that a man who is good at one 
kind of mental work is usually above the average in others^. In technical 
language, most measures of correlation between various mental tests, 
or between various school and university subjects, are positive, and many 
are high. Though some are low, few are negative When this is denied, 
it is generally on the strength of a number of individual cases where 
marked abihty is found in one subject but not in another. These are, 
however, swamped by the much larger number of cases in agreement 
with the principle Because of this fact of predominant positive correla- 
tion, it IS possible, after administering an mtelhgence test lasting one or 
two hours, to predict an individuaFs performance in various mental 
activities with more or less probabihty, though never, of course, with 
absolute certainty. If the known correlation between the test and a 
certain other activity is r, then an individual who deviates d from the 
average in the test (in sigma units) will deviate rd from the average in 
that activity most probably. In practice however such individuals who 
deviate d in the test will not all be exactly at rd in the other activity, 
but will be scattered about it. And that scatter will be less than the 
scatter of an unselected group in the proportion h:l, where h=^/{l — r^). 
The test by its constituent elements probes the mind at a number of 
different points and strikes an average, j‘ust as one finds the depth of a 
lake by plumbing it at various pomts It is then possible to make a 
prediction of its depth at some other point The average of the recorded 
depths would be one such prediction, and this is analogous to using the 
lumped score, or the i Q., in say a Bmet test. A contoured map of the 

* See G. H Thomson, “The Nature of General Intelhgence and Abihty,” Brit. Jowrn, 
Psychol. 1924, xiv. p 229 and other articles of the same symposium at the VII Interna- 
tional Congress of Psychology, Oxford, 1923, by dapar^de and Thurstone, m the same 
Journal. 
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lake bottom, made from the recorded depths, would enable a better 
prediction to be made, analogous to using ‘"profiles” in testing, though 
in testing we do not know the relationship of our elements as we know 
the spatial relationship of the points of a lake 

There is no doubt that such predictions become increasingly pre- 
carious as the general similarity between the performances decreases 
From an intelligence test a prediction of some value could be made of 
a man’s ability to learn to understand the theoiy of relativity: but not a 
prediction of his abihty to throw a cricket ball. And a prediction of his 
probable ability, after traimng, in playing the piano would be between 
the two. Probably it was because the performances considered were 
far apart that Thorndike m his earlier work was led to say that one 
could almost believe that there was nothing whatever common to them 
Since those days tests have been more and more confined to abstract 
activities and correlations have risen, and they have also risen because 
methods of measurement have become more exact. 

With this general fact of positive correlation the controversy under 
consideration has nothing to do. It is concerned with two somewhat 
diSerent ways of explaining that fact 

In the factual meaning, the term general intelligence is non-contro- 
versial. But it has come also to have another and more technical 
meamng, as the name of a general factor g which is supposed, on Professor 
Spearman’s theory, to play a part in all our activities, to be (when they 
are sufficiently dissimilar) the sole cause of correlation between them 
and together with another factor specific to each activity to be the 
complete determiner of performance in that activity. Thomson’s theory 
would explain correlations by assuming that each activity is a sample of 
many factors, much smaller than the factors contemplated by Spearman. 
It is atomic in its tendency, as the Mendehan theory is atonuc. 

As regards this wider area of discussion, it must be remembered that 
Thomson has never questioned the possibility of the Theory of Two 
Factors or claimed that he had disproved it. In his first paper* in 1916 
he wrote: “The object of this paper is to show that the cases brought 
forward by Professor Spearman in favour of the existence of General 
Abihty (g) are by no means crucial. They are, it is true, not inconsistent 
with the existence of such a common element but neither are they 
inconsistent with its non-existence.” In a paper published in 1919 f he 
wrote: “The result of the mvestigation is to confirm the statement 
already made that there are many theories in addition to that of Professor 
* BHt Joum, Psycfioh vul p. 271, f Ibid is. p. 273. 



195 


CH XI] THE PRESENT POSITION (1924) 

Spearmai], whicli will explain such hierarchical order as is actually 
found . . .The essence of all these theories is stated as conclusion ” Thai 
conclusion was an early statement of his Sampling Theory from which 
the distinction there made of elements at two levels has since been 
dropped as unnecessary. And in 1920 Thomson wrote"' of his Samphng 
Theory, “ It does not deny general ability, for if the samples are large 
there will of course be factors common to all activities ” 

Indeed the only acute point of dispute was about Spearman s method 
of supporting his explanation and that may now perhaps be set aside 
since Spearman is engaged in making available the correct criterion in 
place of the “substitute that could supply good approximations under 
certain circumstances but was liable to mislead under others f ” A recent 
paper by Spearman and Holzmger is of considerable importance. In it 
these authors find the probable error of 

F =^13^2-5- 

a quantity which must be zero if the Theory of Two Factors is to be 
confirmed They find 

~ N ~ ^ (h2'’l3"^23 + ^12^14^24 

+ ^13^4^34 + 

;,2 ^ 1 _ 

An approximation got by replacing each r by their mean is 

4^2 (1 _ 

and in this, the term divided by N'^ can be neglected unless both N and 
the r’s are small, and therefore 

a^^2T{l^T)IVN, 

The Samphng Theory is not then a rival of the Theory of Two Factors 
The two theories may be true simultaneously. Both may be useful guides 
m threading a path through the difficulties of constructing and inter- 
preting mental tests. Spearman’s theory has been of incalculable value 
in this way to the English school, and no examples need be quoted 
The Sampling Theory is of use in other situations. By its imagery, for 
example, one can readily appreciate the fact, which in particular Clark L 
Hull has pointed out J, that a new test to be added to a team ought to 
correlate high with the criterion and loio with the present team: and one 

* Psychol Beview, 1920, sxvn. p 184. 
f Bnt J ourn Psychol 1924, xv. p 17. 
j Journ, Educ> Psychol, 1923, xiv. p 396. 
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can go on to see that a new test may also be useful if it correlates low 
with the criterion and high with the present team, provided one siibtmcts 
its weighted score*. 

On the other hand, though both the Theory of Two Factors and the 
Sampling Theory may be true simultaneously they are by no means 
merely alternative ways of stating the same thing They only become 
identical if perfect hierarchical order among correlation coefficients is 
indeed a fact. In that case two factors are all that are needed to express 
completely any activity, one specific and one general, as Thomson has 
always admittedf, and as Spearman and following him Garnett have 
shown, and all that the Sampling Theory in that case does is to split up 
the into an aggregate of smaller factors, a possibility which has 
always been borne in mind also by Spearman, who in his earliest enun- 
ciation (we believe) of his theory adds to the words “have in common 
one fundamental function,” the further qualification “or group of 
functions J.” 

If therefore it can be shown that the quantity F = ^ 13^34 — ^ 23 ^ 14 is? 
within the limits set by its probable error, significantly equal to zero, 
then for tests where this is so the Samphng Theory reduces to the Theory 
of Two Factors. It would not, of course, be sufficient to take cases where 
F had a large probable error* it would be necessary to include cases 
where every effort had been made to reduce the probable error, and 
show that F still did not depart significantly from zero. This task of 
surveying the available data by means of the quantity F we may perhaps 
assume Professor Spearman and his co-workers to be engaged in The 
final result would replace the Hart and Spearman survey of 1912 made 
by the former criterion R'. 

As Spearman himself has shown §, even when F = 0 and the hierar- 
chical order is perfect, it is possible to do without the General Factor and 
use only Group Factors. But there is in this case of course no doubt 
as to the order of preference of the two possibihties, the assumption of 
the presence of a General Factor being a perfectly natural one, and the 
assumption of the presence of a peculiarly related set of Group Factors 
bemg highly artificial 

It is however otherwise when the hierarchical order is not perfect, 
when F departs significantly from zero. The Sampling Theory, which 

* THs latter point, winch had apparently escaped general notice, was stated by 
Thomson m a paper read at the meeting of the New York branch of the Amencan 
Psychological Associaition on Feb. 25th, 1924. 

t See e g Garnett and Thomson, Bnt Jtmm, Faychol 1919, rs. p. 367, in addition to 
earlier references. 

t Amer* Joum. Psychol 1904, xv. p, 284. § Psychol Peview, 1920, xxvn p 164. 
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includes all cases, then no longer reduces to the Theory of Two Factors, 
for it IS then no longer possible to express each activity completely by 
a general and a specific factor A third category of factors necessarily 
enters, composed of Group Factors which are neither entirely specific 
nor entirely general, factors which run through some, though not through 
all of the tests The Theory of Two Factors must m this case be expanded 
into a Theory of Three Factors'^, or better three hinds of factors, the 
three which Thomson has called General, Group and Specific Factors 
Each activity will then be determined by a number of factors, one the 
general factor, one the specific factor and the others group factors This 
IS quite a different matter from the Theory of Two Factors, which by 
its very name denies Group Factors If hierarchical order departs 
significantly from perfection group factors are essential, and no rewriting 
of equations can eliminate them. 

When hierarchical order was perfect we had in a certain sense the 
choice between a General Factor and Group Factors* but the Group 
Factors had to be related in a very artificial way and formed therefore 
a highly unplausible hypothesis When the hierarchical order departs 
significantly from perfection we must postulate some group factors, but 
we still have a choice whether we explain the remaining correlation by 
a General Factor or by Group Factors There is, however, this important 
difference from the case of perfect hierarchical order, that here the arti- 
ficial and peculiar relationships between the Group Factors are no longer 
necessary, in proportion as the perfection of the hierarchy is relaxed 
for the departure of the Group Factors from those relationships is 
equivalent to supplying those Group Factors which must be present 
over and above a General Factor in order to explain the departure from 
F = 0. As long as correlations are all positive any one who wishes to 
do so may postulate a General Factor But unless hierarchical order is 
perfect he must also postulate Group Factors Now the Group Factors 
are the most general of the three categories of factors. The General 
Factor and the Specific Factors are each special cases of Group Factors. 
And therefore, although to postulate as large a General Factor as the 
correlations will allow is in one sense the simplest procedure by way of 
theory, in another and, we think, a wider sense, it is simpler to postulate 
only Group Factors, unless the approach to hierarchical order is so close 
that the Group Factors would be required to fulfil artificial and improbable 
conditions. How high an approach to hierarchical order is compatible 

* This name was proposed by Dr Arthur S Otis, m a copy of a manuscript with that 
title sent to Thomson some time after the pubhcation of Thomson’s 1916 paper, but which 
Otis as far as we know has never published. 
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With unfettered Group Factors? This question Thomson first attacked 
by trying the special case of thirteen Group Factors (represented by 
cards of a suit) arranged in absolutely random order in ten imitation 
tests, and he invariably obtained*** a very high degree of hierarchical 
order. In the same paper he gave the theoretical considerations (repeated 
on pp, 183-8) which led him to make the statement that hierarchical 
order is the natural relationship among all correlation coefficients,” 
meaning not perfect hierarchical order, but some degree of hierarchical 
order, and a larger degree than, he beheved, Spearman had realised *j*. 
To this statement Thomson still adheres Udny Yule, in a critical notice 
of the 1921 print of this book J, says that he parts company altogether 
with Thomson on this point To some extent this may be due to Yule’s 
restriction of the term hierarchical order to cover only perfect hierarchical 
order. But in part, at least, it seems to be a real rejection of Thomson’s 
idea that the laws of sampling apply to the true correlation coefficients 
and not merely to the errors For Yule says ‘^It is not necessarily true 
that 'coefficients of correlation are themselves correlated’ if by this is 
meant that and are positively correlated for any pair of columns 
k and 5. Fluctuations of sampling m the r’s are so correlated ” If Yule 
does reject this idea then he is, we think, mistaken. But it may well be 
that the fault is Thomson’s lack of clearness m explaining, and a re- 
statement of what is contained m certain of Thomson’s articles and 
repeated on pp. 187-8 of this book may perhaps be forgiven. The idea 
IS that true correlation coefficients in a number of organs differ &om level 
equahty for the same kind of reason that sampled values of truly equal 
correlation coefficients difier from one another that when equal correla- 
tion coefficients appear to differ the reason is that the samphng has 
caused certain elemental factors to be present or absent simultaneously 

* Proc Boy Soc 1919, xov. A, p 400 

t In the Psychol Beview, 1914, xsi p 109, as a footnote to the phrase “ the correlation 
between columns .must be zero,^* Spearman says. “A similar result ensues from the not 
unplausible hypothesis, that each performance depends on a randomly selected group of 
very numerous independent elements and that the correlation between any two perform- 
ances is due to some of the elements happening to be common to both groups, For it could 
easily be shown that under these assumptions the correlation (compensated for sampling 
errors) between any two columns will tend to equal the correlation (uncorrected for 
attenuation) between the two performances from which the columns derive, .and both 
win average htUe more than zero ” The proof ^of this was not given then, nor as far as we 
know has it been published smce, though Spearman has referred to it again, e g in Bnt 
Joum. Psychol 1916, vm p. 283, and through Webb in “ Character and Intelligence {BriL 
Journ Mon, Supp, 1915), pp. 57 and 82 Its pubhcation seems to us very desirable, as 
Thomson’s expenence is that (supposing none of the elements are mterference elements 
but all are positive) the hierarchical order will be much greater than this, at any rate if the 
elements axe *‘ail-or-none” in action 

J Bnt, Journ, Psychol, 1921, xn. p. 104. 
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as though identical, or has happened to select cases where identical 
elements usually present m both instances happen to be missing in one . 
that philosophically and mathenqiatically the difierences between really 
different correlation coefiScients are also of this nature, for the variates 
are diSenng samples of the underlying elements. Thus if the correlations 
between three tests a, h and c were really equal, then in a given sample 
they would differ because (apart from errors of measurement) the bonds, 
which m a larger sample are so distributed as to make them equal, 
happen to be otherwise distributed* and if on the other hand the correla- 
tions really differ, this is still due to a sampling of the elemental factors 

All this seems, to Thomson, to be merely a verbal expression of 
Pearson and Filon’s formulae, and as long as the bonds causing correla- 
tion are positive, that is increase the variate in each instance if present, 
then there is bound to be some measure of hierarchical order among all 
correlation coefficients, the degree of perfection due to this cause being 
the point in dispute. Mr Udny Yule has declared that in his experience 
he has not found hierarchical order among coefficients, except in psycho- 
logical measures. But it is very unusual to find, in other correlational 
fields, all the mtercorrelations measured and set out, and though Thomson 
has unfortunately not had time from other duties to make a proper 
search, he finds some hierarchical order when the measurements permit 
of its discovery m the few instances examined. This point might well 
form a special mquiry. 

Where the bonds are not all positive, but include interference factors 
which help one and hinder another variate, hierarchical order is probably 
less pronounced. If interference factors were as common as are mutually 
helpful factors, however, correlations would all tend to zero. It seems 
that in the realm of mental tests we have a province where the fact of 
general positive correlation implies that interference factors are m the 
minority. Positive bonds are the usual tendency. Whether these positive 
bonds are grouped entirely into a general factor g, leaving no residue, 
or an msignificant residue, of group factors, or are less uniquely grouped, 
appears to us still undetermined. But we must repeat that, while group 
factors may or may not be present, as long as the correlations are mainly 
positive a general factor may, of course, be postulated, and the con- 
troversy between us and Professor Spearman is not, and never was, 
as to the possibihty of thus postulating a general factor, but as to the 
possibihty of explaining all correlations thus without postulating any 
but the slightest group factors, and these very narrow in their action. 
Our position is that until the evidence is more clear we shall contmue 
to suspect that numerous and wide group factors are present. 
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THE aiATHEMATICAL AND EXPERIMENTAL EVIDENCE FOR 
THE EXISTENCE OP A CENTRAL INTELLECTIVE FACTOR (gr)* 

[From The British Journal of Psychology {General Section), 

Vol XXIII, Part 2, October, 1932] 

By WILLIAM BROWN 

If a number of sufficiently dissimilar mental tests of intellective ability 
be applied to a group of individuals and correlation coefficients calculated, 
it IS found that these correlation coefficients are related to one another in 
such a way that for any four (or tetrad) of them the following relation 
holds good, within the limits of random samphng, viz. 

~ ^ ( 1 )? 

and similarly with other arrangements of these four tests. We owe both 
the discovery of fact and the devising of the tetrad criterion to Professor 
C. Spearman. 

The inference drawn from this is that the abihties measured by the 
mental tests are divisible into two factors each, the one being common to 
all (the general factor, g), while the other is in each case specific and 
mdependent (s). 

In Professor Spearman’s own words. Whenever the tetrad equation 
holds throughout any table of correlations, and only when it does so, then 
every individual measurement of every abihty (or of any other variable 
that enters mto the table) can be divided into two independent parts 
which possess the following momentous properties. The one part has been 
called the ‘general factor’ and denoted by the letter ‘gr’; it is so named 
because, although varying freely from individual to individual, it re- 
mams the same for any one individual in respect of all the correlated 
abihties. The second part has been called the ‘ specific factor,’ and denoted 
by the letter ‘s.’ It not only varies from individual to individual, but 
even for any one individual from each abihty to another f.” 

The relationship is expressed by the following equation: 

^<xx “ '^ag 9x *••• (^)> 

* Commmucated to Section J (Psychology) of the British Association for the Advance- 
ment of Science, London, Sept 25th, 1931 — and, with certam additions, to the Tenth 
International Congress of Psychology at Copenhagen, Aug. 24th, 1932. 

f C. Spearman, The Abilities of Man, London: Macmillan & Co Ltd. 1927, pp. 74, 75. 
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where niax = the measurement obtained for any individual x in the 
variable a, Qo. = the individual’s amount of g, the factor common to all 
the variables, and s^x = the individual’s amount of s^, the factor specific 
to the variable a 

The method of applying the tetrad criterion is to draw up a frequency 
distribution of all the possible tetrad differences derivable from the table 
of correlation coeficients (there being 3 positive tetrad differences 
and an equal number of negative ones, where n is the number of mental 
tests correlated with one another) and to compare its standard deviation 
with the ‘‘theoretical” standard deviation of a purely chance distribution 
of such tetrad differences. A formula for the latter has been calculated by 
Spearman and Holzinger'^, viz 

if - ‘ (I - f )» + [l - 3.- + 2,- . j (3). 

where N = number of cases, n — number of tests, r ~ mean of correlation 
coefiicients, s = standard deviation of correlation coefficients, and 
dt = the average value of the standard deviation of the tetrad differences 

In applying this formula, ctj is generally multiplied by 0 G7449 to give 
a “conventional” p e , but since the frequency curve of tetrads is not, 
and cannot be, an exact probability curve (because the correlation 
coefl&cients, and therefore the tetrads, are not uncorrelated with one 
another), although it approximates to one, there is little to be gained by 
this procedure 

As the formula for the probable error of tetrads allows for the effects of 
“ attenuation ” upon correlation coeiffcients, so that these coefiS.cients need 
not be corrected for observational errors, the “tetrad criterion” escapes 
criticism of imnef which was, as I still contend, rightly directed, in certain 
cases, towards the “correction formulae” which Professor Spearman de- 
vised in 1906 and 1910 to adjust for such errors It also takes the place 
of the criterion of “intercolumnar correlation,” or correlation between 
columns of correlations in a table of correlation coefficients, upon which 
Professor Spearman previously rehed in proving his theory. According to 
this criterion, the average intercolumnar correlation should approximate 
to unity if the Theory of Two Factors holds goodj. But the correlation 
coefficients had first to be “corrected” for errors of observation (by 
formulae whose general or umversal apphcabihty I dispute), and even 

* C Spearman and K. Holzinger, “The Average Value for the Probable Error of 
Tetrad Differences,” Bnt Journ Psychol 1930, xx p 370 

t Essentials of Mental Measurement, Cambridge The University Press, 1st edition, 
1911, pp 83 — 85. Bnt, Joum, Psychol 1913, vi p 223 

t This is the famous “hierarchical order” of correlation coefficients. 
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then the criterion was only applicable to those coefficients which reached a 
certain '' correctional standard/’ and thus did not admit of application to 
the whole table of correlation coefficients, as the tetrad criterion does. 

In my own research work with mental tests in 1909, 1910 and 1913, 1 
did not feel justified in considering my results as confirmatory of Professor 
Spearman’s theory, because of the above-mentioned difficulties But on 
the other hand I never contended that my results disproved his theory 
In the Essentials of Mental Measurement, 1st edition, 1911, I wrote* 
“A de fini te solution of the question of the existence or non-existence of 
one central mental abihty is yet to be sought It can only be obtained by 
the use of much larger random samples than those hitherto employed, 
since the probable errors must be small compared with the coefficients, if 
precise inferences are to be drawn from the latter, and m the case of 
small samples this condition is satisfied only for large correlation co- 
efficients, which when obtained are often merely the result of selecting 
tests which measure closely similar mental abilities In all results hitherto 
quoted in support of ultimate identity of general mtelhgence and general 
sensory discrimination, the correlations contributed by the latter are so 
small compared with then p e ’ s that nothing defimte can be inferred from 
them” (p. 120) My verdict at that date had to be ''Non-proven,” but 
certainly not ''Disproved.” 

Nevertheless, in the interests of history and of scientific completeness, 
it seems worth while to work over some of those earlier results of mine 
with the aid of the tetrad criterion I have done this with (I) a group of 
66 boys, aged 11-12 years, of an Elementary School (Essentials of Mental 
Measurement, 1st edition, p. 114), (II) a group of 40 boys, aged 11-12 
years, of a Higher Grade School (ibid p. 116)*, and (III) a group of 83 
boys, aged 14-16 years, of a Public School (St Paul’s School), examined 
in mathematics only| In the fijst two groups I have pooled correla- 
tions between too-closely related abilities, in conformity with Professor 
Spearman’s criticism, and m the third group I have refrained from 
"partiallmg out” for difference of form (the boys were drawn from five 
different forms) as this difference itself was some measure of difference of 
mathematical abihty. 

In Group I, with 8 tests, the total number of positive tetrad differences 
IS 210. The observed median tetrad difference is 0*0208, and the esti- 

* Both in “Some experimental results in the correlation of mental abilities,” BnU 
Jouf% Psychol. 1910, ur. p 296. 

t “An Obiectwe Study of Mathematical Intelhgence,” BiomeinJca, 1910, to. p. 352. 
The table of correlation coefficients, uncorrected for difference of form, is given in my Mind 
and Personality, University of London Press, Ltd. 1926, p. 123. 
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mated value is 0-024, wkich may be compared with the ‘‘theoretical” 
p E. value, calculated by the Spearman and Holzinger formula, 0-0353. 
Moreover, = 0 0456, which gives another value of the conventional 
PE, viz 0-67449a, = 0 03076, which is also below the “theoretical” 
value These results, so far as they go, are all in favour of Spearman’s 
two-factor theory. The distribution of tetrads is markedly leptokurtic, 
and jSg == 4-275, as compared with ^ 2 "^ ^ ^ Probabihty Curve. 

In Group II, with 8 tests and therefore 210 positive tetrads, the 
median tetrad difference is 0*0528 The “theoretical” p.e. (S and H ) is 
0 0495, which shows a difference of 0*0033 on the wrong side But 
Gi = 0*069, giving another value of the conventional p e. 0 0465, Vrhich is 
in conformity with the two-factor theory 

The distribution of tetrads is markedly platykurtic == 2*358. 

In Group III, with 9 subsidiary mathematical abilities intercorre- 
lated, and therefore 378 positive tetrads, the results are 

Median tetrad = 0*0761, “Theoretical” p e (S. and H ) — 0*0379, 
Mean tetrad = 0*1201, 

Gi = 0*1612, giving “Conventional” p e. = 0*1087, 

(i.e. = 0 02601, = 0 002637 jSg = = 3-9041, 

1^2 

1 e > 3 (a leptokurtic curve). 

Although this group furmshes a smooth frequency curve of tetrad 
differences, the results give httle support to any theory of a central 
mathematical factor. No such theory has been put forward by Professor 
Spearman himself, and I have only introduced this group as a good 
illustration of the working out of the tetrad criterion on fairly adequate 
statistical material*. Whether the excess of g^ over the corresponding 
Spearman-Holzinger value is statistically sigmficant could only be de- 
cided with precision by determining the standard deviation of g^ This 
involves the use of comphcated formulae devised by Professor Karl 
Pearsonf. 

But the results m Groups I and II, as far as numbers allow, do support 
the existence of a central intellective factor {g), and, when taken in 
relation with the large body of similar evidence accumulated during the 
last twenty years by Professor Spearman and his students, help to give 

* My thanks are due to Mr R. J Bartlett, M Sc , for calculating tetrad differences and 
certain constants in this research I have myself re-calculated all the results, apart from the 
tetrad differences 

f Applymg these formulae, I find pb. of 0 001175, and therefore pe of 
p B.= 0*0007928. Hence the evidence is agamst the existence of a central mathematical 
factor. 
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solid basis to that theory. A mathematically satisfactory proof of the 
theory would involve much larger numbers, both of individuals tested 
and also of non-overlapping tests of intellective ability to be used upon 
them. In a critical article by Professor Earl Pearson"^ on this subject the 
following paragraph appears ^'We suggest that some 12 to 15 abilities 
(66 to 105 correlations, 1485 to 4095 tetrads), the abihties being settled by 
psychologists a pnon to avoid 'overlaps,’ are essential to a satisfactory 
test, the observations to be made on a homogeneous population of several 
hundreds. Short series involve such large probable errors that a mere 
statement that theory and observation are in accordance within the 
hmits of the probable errors can carry no conviction with it ” 

I have organised a research along these hnes, with the kind help of 
Professor Spearman and Dr W Stephenson of University College, London 
Dr Stephenson has devised a series of 20 tests of apparently non-over- 
lappmg intellective ability (selected not exactly a jpnon but after much 
careful prehminary trial), which received the approval of Professor 
Spearman, and has applied them for me to 300 boys, aged 10-1 OJ years, 
drawn from 12 Elementary Schools of the L C C , forming a homogeneous 
"random sample” of adequate size for statistical purposes The total 
number of positive tetrad differences is 14,536 It has since been found 
necessary to reject one of the tests and one of the correlation coefficients 
There remain 11,356 positive tetrads which form a smooth frequency 
curve, the mathematical properties of which I am now working outf 
I have found that the best-fitting frequency curve is a Type II a Pearson 
curve, with equation 

y = 1412 ^1 — • [Umt of grouping = 0 005 ] 

The curve is platykurtic, with jSg = 2*81446 The standard deviation, 
cTj, = 0 031289 ± 0*002586 If we compare this with the "theoretical” 
Spearman-Holzinger value, dj = 0 02827, we find an excess of 0*003019, 
bemg 1*167 times the probable error This indicates a good correspondence 
of observation with theory. But only after much further psychological 
and mathematical analysis of the enormous mass of data can a final con- 
clusion be drawn. The material satisfies the most stringent demands of 
statistical theory and will furmsh a precise and defimte solution of the 
problem of a Central Intellective Factor. 

* Karl Pearson and Margaret Monl, “The mathematics of mtelhgence, I The samphng 
errors m the theory of a generahsed factor,” Biometnkat 1927, p, 261 

t This IS set ont m the followmg chapter (Chapter XIII) 
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Group I. 66 hoys, aged 11-12 years. Elementary School 


Correlation Square 




1 

2 

3 

4 

5 

6 

7 

8 

1 

Combination 

— 

0 52 

0 52 

0 39 

0 46 

0 13 

0 00 

0 15 

2 

Memory, poetry 

0 52 

— 

0 49 

0 39 

0 27 

012 

0 05 

0 13 

3 

Memory, mechamcal 

0 52 

0 49 

— 

0 29 

0 34 

014 

012 

010 

4. 

Addition 

0 39 

0 39 

0 29 

— 

0 41 

0 12 

0 03 

0 20 

5 

Letters (ER+ANOS) 

0 46 

0 27 

0 34 

0 41 

— 

0 37 

010 

0 00 

6 . 

Motor Ability 

0 13 

0 12 

014 

012 

0 37 

— 

0 04 

0 00 

7 

Illusion (M -L ) 

000 

0 05 

0 12 

0 03 

0 10 

0 04 

— 

016 

8 . 

Bisection 

0 15 

013 

010 

0 20 

0 00 

0 00 

016 

— 


No of + ve tetrad differences of form 9*24 - 7*14 rgg = 3 x = 210 


Symmetrical DistnbuUon of Tetrad Differences 



Size of tetrad 


Distribution of Positive Tetrads 

CO <MOO tH OcOtMOOTftO 

rH COCOOl— !CSJ’Tt <0 

o 00 OOOi— trHrHf-H 

O OCSJ OO-rHOCOCNOO^ 

O f-iCO ■H^OQ005rH0qirt< 

Range of tetrad o 00 0000000 Total 

Frequency 81 49 20 30 13 8 2 2 3 2 210 

Observed median tetrad difference =0 0208. 

Estimated „ „ „ =0 024. 

Observed or of tetrad differences =0 0456 
, Conventional p E. = 0*67449or = 0 03076 
“Theoretical” p E (Spearman and Holzmger) =0 0353. 

^2=0 00207846, 000018469, 

leptokurtic curve). 

/Ig 
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Group II. 40 boys, aged 11-12 years Higher Gmde School 
Correlation Squaie 


12345678 


1 

Intelligence 

(S Marks + Gen Intell.) 

— 

0 585 

0 645 

0 465 

0 26 

0 23 

0 445 

0 275 

2 

Memory, poetry 

0 585 

— 

0 44 

044 

0 00 

0185 

0 38 

019 

3 

Combination 

0 645 

044 

— 

0 46 

0 32 

0 05 

0 28 

0 28 

4 

Drawing 

0 465 

0 44 

0 46 

— 

0 14 

0 15 

0 39 

0 00 

5 

Addition (speed) 

0 26 

0 00 

0 32 

0 14 

— 

0 275 

0 00 

0 20 

6 

Letters (ER + ANOS) 

0 23 

0 185 

0 05 

0 15 

0 275 

— 

0 00 

0125 

7 

Memory, mechanical 

0 445 

0 38 

0 28 

0 39 

0 00 

0 00 

— 

0 00 

8 

Motor Abihty (all letters) 

0 275 

019 

0 28 

0 00 

0 20 

0 125 

0 00 

— 


Symmetrical Distribution of Tetrad Differences 



Size of tetrad 



CO 

1 > 


0 

1 


Total 

210 


Median tetrad difference = 0 0528 
Observed a of tetrad differences = 0 069. 
/ Conventional p e =0 0465. 
"Theoretical” p e (S and H ) =0 0495. 
^^2=0 004755, p4 = 0-000053308, 

.’ j 82=2 358 (a platyknrtic curve). 


Group III. 83 boys, aged 14-16 years Public School 
Mathematical Examination, 1910 


Correlation Square 



C 

H 

E 

I 

G 

A 

E 

D 

B 

c 

— 

0 57 

0 47 

0 55 

0 59 

0 78 

0 51 

0 81 

0 60 

H 

0 57 

— 

0 69 

0 92 

0 53 

0 61 

0 55 

040 

0 26 

E 

0 47 

0 69 

— , 

0 57 

0 76 

044 

0 82 

0 46 

0 23 

I 

0 55 

0-92 

0-57 

. — 

0 49 

0 47 

0 49 

0 43 

0 22 

G 

0 59 

0-53 

0 76 

0 49 

— 

0 41 

0 64 

044 

0 26 

A 

0 78 

0 61 

044 

047 

0 41 



0 46 

0 65 

0 49 

E 

051 

0-55 

0 82 

0 49 

0 64 

0 46 



0 49 

0 28 

D 

0 81 

0-40 

0-46 

043 

0*44 

0 65 

0 49 



0 37 

B 

060 

0-26 

0*23 

022 

026 

0*49 

0 28 

0 37 

— 
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Geometry 

A Memory of Definitions and General Prmciples (e g prmciple of superposition), 

B. Memory of constructions 

0 . Memory of preceding propositions and power of applying them 
D. Becogmtion of necessity of generahty in proof, and power of recognismg general 
relations m a particular case 

Arithmetic 

E Accuracy. 

E General memory of rules and power of applying them, 

G Bower of domg sums in percentage and proportion 

Algebra 

H Accuracy. 

I General memory of rules and power of applymg them. 

No of +ve tetrad differences of form ?*i3? 24 ”^14^23=^ ^ ®G 4 = 378 . 


Symmetncal Distribution of Tetrad Differences 



Size of tetrad 



208 


INTELLECTIVE FACTOR (g) [pt. ii, ch. xii 


Distribution of Positive Tetrads 


CD 

0 


00 

CM 

0 

CO 

0 

1 

0 

1 

? 

7 

3 

0 

0 

CD 

0 

(M 

»«— 1 

00 

1— H 

0 

0 

0 

0 

6 

153 

85 

52 

36 

19 


Range of 
tetrad 


The constants of this distribution are 
Median tetrad = 0 0761. Standard deviation, G^i =0 161276. 
Mean tetrad = 0 1201. 0 67449(7^=0 10878. 

“Theoretical” p e. (S. and H ) = 0 0379 
02601, ^4=0 002637 

• • — leptokurtic curve). 


The best-fitting curves to the distributions are Type II a (platykurtic) and Type II b 
(leptokurtic) Pearson curves The actual equations to the three curves are 

- « T 65 11 

for Group I, y = ^ .5. , 


for Group II, 
for Group III, 


\ 54 445 J 

,=34 754(z-j5? 
121 63 

^■*■62 3976/ 



CHAPTEE XIII 

A TEST OF THE THEORY OE TWO FACTORS 

[From The British Journal of Psychology {General Section), 

Yol XXIII, Part 4, April, 1933] 

By WILLIAM BBOWX and WILLIAM STEPHENSON 
(1) INTRODUCTION 

In a critical article by Professor Karl Pearson (i) on tbe Theory of Two 
Factors it is suggested that some 12 to 15 abihties the abihties being 
settled by psychologists a jpnon to avoid 'overlaps/ are essential to a 
satisfactory test [of this theory], the observations to be made on a homo- 
geneous population of several hundreds” (p 261) The present paper 
describes a test of the kind that Professor Pearson demands, using corre- 
lations for some 20 abilities The research was orgamsed by one of us 
(W. Brown) over a year ago, in connection with his re-testing of his 
own earher correlational material by Professor Spearman’s "tetrad 
criterion” (2), and he has made himself particularly responsible for the 
mathematical arguments and conclusions of the investigation, including 
the curve-fitting. But the mental tests were devised and apphed by Dr 
W. Stephenson, and the correlation coefficients and tetrad differences 
were also calculated by him Some prehmmary remarks, from both 
psychological and mathematical viewpoints, are called for. 

(2) THE VIEWPOINT OF EXPERIMENTAL PSYCHOLOGY 
The psychologist does not select the 20 abilities on a narrow a pnon 
basis. The abihties are found by a slow process of experimentation and 
test refining. Moreover, this experimentation is itself based upon the 
theory of two factors. The psychologist devises tests that, approximately, 
should fit a theoretical criterion (that of zero "tetrads”)*. 

But it betrays a misconception of the nature of a scientific theory to 
say that, thereby, the psychologist is working in a closed circle. On the 
contrary, he works like a physicist; he estabhshes the fact that under 
certain conditions the criterion is satisfied, and he determines the nature 
of these conditions. The core of the matter is that in this way, and 
generally, the theory of two factors works for psychology. "When reason- 

* Other tests can be devised, likewise, that should not fit the criterion, as is the case 
when tests are too similar. 
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able agreement is found between tbe criterion and correlational facts, 
tbe common factor can receive an acceptable psychological explanation 
When the criterion and facts do not agree the psychologist makes a 
determination of ‘‘overlap/’ “ group factors,” or “ specificality*^.” Again 
(and this is the essential matter), it is found that either the specificalities 
have acceptable psychological explanations, the true influence of which 
had been neglected, or that a field of research is opened up for facts that 
are essentially new and unexpected 

Thus, what for mathematics is a failure of the criterion is for psycho- 
logy a pointer to new psychological findings The proof of the theory is 
much more than a purely mathematical matter There is m the proof the 
foundation and development of a scientific experimental psychology; 
and, although we would be modest, to that extent it constitutes a 
“Copermcan revolution” The mathematician, given the data, might 
prove the theory to acceptable limits — it is so proved, even for the 
exacting conditions laid down by Professor Pearson, in the course of the 
present paper. But only the psychologist can now disprove the theory 

The mathematics and the psychology of the theory of two factors 
are now so developed that the mathematician, before he can test out 
some of his sub-theories, can scarcely proceed unless the experimental 
data are as precisely as possible of the kind that the psychologist daily 
tries to supply for the progress of his science. It seems that neither the 
mathematics nor the psychology can be absolutely rigorous, any more 
than is the case in physics, and neither can proceed without the other. 

(3) AN EXAMPLE OE THE WORKING OE THE THEORY 

An illustration of the modus ojperand% of the theory of two factors 
can serve to* amplify the above viewpoint and introduce some of the 
requirements of a test of the theory. 

It was found by one of us (3) that verbal intelhgence tests did not, 
whereas certain non-verbal tests did, agree satisfactorily with the tetrad 
criterion. A theory of an additional u-factor, a group factor, was tried 
out for the verbal tests, and with further researches the full force of 
the influence of reproduction and experience on these verbal tests was 
made apparent. It now appears that only when past achievement, and 
therefore the r6ie of retentivity and reproduction, is rendered as simple 
as possible, as when primarily perceptual tests are used, does the criterion 
agree well with the facts, A r61e for past experience and reproductive 
processes can scarcely be denied for the verbal tests, and the theory of 

* The term **specificality” covers both positive (“overlap,” or ‘‘group factor”) and 
subtractive or negative influences. It stands for any disturbance of the tetrad criterion. 
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two factors works because it isolates in a ^-factor tbe activities m which 
experience and reproduction are strongest and most to be expected. 
Pan passu, the theory works in so isolating a purer field of perceptual 
tests within which eductive processes can be considered to hold sway. 

(4) REQUIKEMENTS FOE A TEST OF THE THEORY 

The important requirement is the set of 20 or so non~overlapping 
abihties. 

It has been shown (4) that non-verbal tests, that were primarily per- 
ceptual in form, supphed correlations agreeing with the theory of two 
factors for a population of 1000 , and, as has been suggested above, the 
non-overlapping tests are most hkely to be those of perceptual foundation. 
The work of Line (5) must be mentioned as a pioneer study with such a 
test. At the time of begmmng the present research there were not 
available 20 sufficiently developed primarily perceptual tests But some 
non-verbal tests can be used, with the knowledge that many serve as 
'"pure"’ ^r-tests, each with ^-factor and factors specific to the test, the 
latter condition obtaining because of the narrow range of the experiential 
or reproductive influences in them For this reason two or more non- 
verbal tests, themselves not perceptual in any critical way, might act 
as “reference values’" for the primarily perceptual tests. The common 
visual fundaments of the latter may thus be controlled for specificality, 
although it seems impossible to conceive of any test that is less critical 
for all but eductive processes than these latter We had available, then, 
11 primarily perceptual, and 5 non-verbal, tests. 

Now any one verbal test could be used together with the above 
16 tests, in spite of ^-factor content, because the ?;-factor would then be 
specific relative to the set-up of tests. But, in spite of their -y-factor 
content, there were compensatmg reasons that made it desirable to 
include more than one verbal test m our battery. Verbal tests lend 
themselves to a freshness of working that helps along a long day’s 
testmg, and they introduce high correlations with some of the per- 
ceptual and non-verbal tests. Of greater moment, there would seem to 
be no reason why a partialhng device should not be used, whereby the 
'y-factor is partialled out, leavmg the mtercorrelations amongst the verbal 
tests attributable to a ^-factor, so that these partialled correlations 
might then be used as non-overlapping values, then comparable with 
the correlations amongst the perceptual and non-verbal tests themselves. 
Evidence could be sought in the present work for the applicability of 
such a partialhng techmque. Thus, we added 6 verbal tests to our 
battery, making 22 tests in all. 


14—2 
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With these tests specially prepared for group application to children 
of the age upon which it was decided to work, we have only to guard 
against sources of specificality of the varieties described by Spearman (6), 
and data should ensue that are suitable for the mathematician’s detailed 
examination. A test of the theory of two factors reqmres a correlation 
table showing steep hierarchy, so that some of the tests need not be 
highly intercorrelatable. It would seem that a population of 300 is a 
mimmum for use in fine correlational work 

(5) THE TESTS AND THEIR APPLICATION 

Table I names the various tests, in order of apphcation to the testees 
The following notes will help to give meaning to the table. 

Three hundred boys were tested in groups of not more than 25 per 
group. The boys were of age 10 to lOJ years at the time of testing, and 


Table I. Showing the tests in order of application 


Testing 

period 

No. 

Type 

Test name 

Time 

allowed for 
demon- 
stration 
mm. 

Time 

allowed for 
the test 
proper 
mm 

1st 

1 

V 

Inventive synonyms 

2 

3 


2 

n 

Alphabetical form 

5 

4 


3 

n 

Alphabetical series 

3 

8 


4 

V 

Disarranged sentences 

2 

6 


5 

P 

Fittmg shapes 

3 

8 


6 

V 

Understandmg paragraphs 

1 

12 

2nd 

7 

p 

Mazes 

2 

4 


8 

n 

Cancellation 

3 

3 


9 

P 

Pattern perception 

4 

5 


10 

P 

Analogies form 

5 

6 


11 

P 

Classihcation “ rights ” 

6 

12 

3rd 

12 

n 

Mutilated pictures 

2 

4 


13 

P 

Overlappmg shapes 

6 

6 


n4 

V 

Inferences, selective 

2 

6 


15 

P 

Abstraction “pairs” 

4 

8 


16 

P 

Code 

2 

3 


17 

P 

Code-parts 

2 

H 

4tli 

18 

V 

Classification, selective 

2 

4 


19 

n 

Arithmetical equations 

4 

6 


20 

V 

Proverbs, selective 

2 

10 


21 

P 

Series form 

5 

8 


22 

P 

Pitch perception 

5 

10 


were all the boys of that age in the two or three elementary school classes 
usually accommodatmg that age. Boys in lower classes, or those who 
suffered obviously from physical or scholastic disabihties, were not tested. 
Each group of boys attempted aU 22 tests on the one school day, in four 
testing periods of about an hour each, commencing at 9.30 a.m., and 
ending at 4 p.m. A standard procedure was followed of demonstrating 
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at least six sample test-units on the school blackboard just before be- 
ginmng each test, and then allowing a fore-practice period to the testees, 
using test-units printed on the covering page of the test proper. The 
time allowance for demonstration and fore-practice, and for the test 
proper, is shown in Table I for each test. 

A number is given to each test in Table I: the letter ''p'' following 
the test number indicates that the test is primarily perceptual, whilst 
‘'n’’ and mdicate that the tests are non-verbal and verbal re- 
spectively. 

The tests numbered 1, 2, 3, 4, 5, 6, 10, 12, 13, 18 are described in 
previous papers ( 4 ); and m each case the test used in the present work 
was a development of that of the same name used in the work on 1000 
children. Tests 10 and 11 are of the t 5 rpes developed by Fortes ( 7 ) and 
Line ( 5 ) respectively. No. 22 is the ‘‘Pitch Perception” of Seashore’s 
Musical Ability Test (8), apphed by gramophone. No. 7 consisted of a set 



Fig.l 

of mazes of the well-known Porteus kind, but here prepared specially 
for group application. Nos. 8, 14 and 20 are considered to be sufficiently 
known by name. It is not considered necessary to enter mto further 
descriptive details about any of the tests mentioned above, so that only 
the tests numbered 15, 16, 17, 9 and 19 need be given a short description. 

Fig. 1 shows a test-umt of the “Abstraction” test (No. 15). The pair 
of drawings at the left-top are alike in a certam way, the second pair 
at the left-bottom are also alike m a certain way; and two of the six 
drawings numbered 1 to 6 have to be selected m which both the above- 
determined hkenesses are to be found. 

The Code test (No 16) is a Substitution test. In No. 17 the same 
code items are used, but only parts of the code items are now provided, 
and the testee is required to substitute under each part the code number 
of the complete item. Fig 2 (a) shows the code items used in test No. 16; 
and Fig. 2 (6) shows a short row of code-parts of test No. 17 — the numbers 
3, 2, 4, 1, 5, 6, . . etc., have to be substituted under these code-parts. 

In test No. 9 (Pattern Perception) a pattern is given at the left, and 
this can be found exactly in the more complicated pattern at the right. 
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a line has to be drawn around the determined pattern at the right. 
A test-unit is shown m Fig 3 

A sample test-unit of the Arithmetical Equations test, No. 19, is as 
follows : 

3 9 5- 7. 


The signs + and — have to be placed between the numbers at the left 
side of the equation, so that the left side then equals the right side, i e. 


3 -1- 9 ~ 5 - 7. 


j\Kn=Ax 


\ Z 3 A- 5 6 

(a) 

CK-TA'h.L,- im 


(6) 

Fig. 2 


+ 4- 


+ + + 

+ + •*• + 


4 4 


4 + + 


4 


4 4 


Fig. 3 

(6) SCOBESTG AM) CORRELATION CALCULATION 

The tests were scored by two competent psychologists, one test at a 
time for any one group of papers. 

Because almost all the tests had been used previously in work on 
10-11 year old groups, and were developed in accordance with results 
obtained for this age, the scatter of the score m each test was approxi- 
mately ^^normaV But, to obviate any disturbances in tetrads attribut- 
able to non-normal score distributions, a first step in the calculational 
work consisted in converting the crude scores for each test to values fitting 
a standard scale. The standard scale, used for every test, ranged from 
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score 0 to score 19, with, frequencies 1, 2, 4, 7, 10, 15, 21, 27, 30, 33, 33, . . . 
and again downwards to score 1, for the scores 0 to 19 respectively'^. 

Correlations were calculated, using the difference’’ methodf The 
'' differences” were squared and added, using Burrough’s Adding Machine 
with tape recording Seven-figure logarithms were used in all calcula- 
tional work. But the available multiplication tables that were used later 
were for tetrad calculations for three figures only, so that it is sufficient 
to report correlations to three places of decimals only. 


(7) CORRELATIONS 


Table II shows the first correlation table for 20 of the 22 tests The 
tests numbered 21 and 22 are not used m the present work, because 
20 is a sufficiently large number for our present purpose. The two, 21 
and 22, were held in reserve, they were the tests last apphed in the day, 
and this is the only reason why they, rather than any other of the 
22 tests, are held in reserve. 

But Table II cannot be employed as it stands for the test of the two- 
factor theory. Six of the tests are verbal, entailing a v-factor, and two 
of the non-verbal, perceptual tests also entail specificahty. There is 
required a procedure for partiaUing out such specificahties, and the 
following was adopted 

(i) First the ^-factor is partialled out of the set of tests involving a known speoifi- 
cahty, using perceptual tests as “reference values ” Thus, taking the ^;-f actor as a 
known specificahty, the gr-saturation of any verbal test is given by the following 
equationf: 

rvpj+ 

Using ^'-saturation values obtained m this way, the g'-factor is partiaUed out of the 
tests involving the known specificahty by use of the following equation: 


^ViV2 ^V20 


(ii) Using the ^-partialled correlations (“specific” correlations) given above, the 
specificahty saturation is next determined. This repeats the first step of (i) above: 
thus, the t?-saturation of any verbal test is given m terms of the other verbal tests 
by the foUowmg equation 


; — z — 


* For a description of the converting method, see Stephenson{4). 
f ^ _ SXg + S 7^ - S (X - 7)^ - 

J The subscripts “v” and “p” refer to “verbal” and “perceptual” tests respectively. 
The notation used m these first sections must not be confused with that of the Statistical 
Evaluation of Results, p 220. 
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(lu) Now restart with the first correlations, and partial out the specificality, 
using the specificahty-saturationa given at (ii) Thus, to partial out the ^;-factor 
use the v-saturations determined as at (ii) in the following equations. 




V A Vig V ^ ^ * V2g I' 


The step (ii) caa only be taken when the specificality correlations 
given at (i) themselves fit the tetrad criterion, there must therefore be 
at least four tests involving the same specificahty, although three tests 
serve to determine specificality saturations. In most cases, however 
(other than for well-defined group factors like the ^-factor), specificahty 
is observed for two tests only, but to a first approximation the square 
root of the specific correlation can be taken to be the specificality 
saturation of each of the two tests Using this saturation value, the 
specificality can be partialled out as at step (in) above 

The above partialling procedures are theoretically warranted in our 
work, and we do not offer any further substantiation of them, but it 
should be observed that the probable errors of the above partial corre- 
lations are not known, although they can be considered to be a httle 
greater than those for the first correlations. 

Apart from the -u-factor there is obvious specificality in two corre- 
lations only m Table II, for the two Code tests (Nos. 16 and 17), and for 
two perceptual tests (Nos. 6 and 9). The Code tests are, of course, too 
similar to be free from overlapping. Using the above partialling pro- 
cedure we can partial out Code-specificality, leaving a correlation 3,7 
attributable to gr-factor only. In this way the first correlation 0*64:4 is 
reduced to 0*452. As for the tests 5 and 9, it was the first time that both 
had been used together in a correlation table, and the tests are apparently 
too similar in some way, the spatial fundaments are similar and both 
require a certam drawing ability. Both have fairly easy test-umts, and 
thus ''speed-preference’’ is not an unlikely disturbance. But the corre- 
lation 9 need not concern us further, we shall find later that the test 
No. 5 is the source of other disturbances The above partialling pro- 
cedure results in a value 0 518 in place of 0*655 for 9, the value 0*518 
now bemg attributable to ^^-factor only. 

A correlation table "corrected” for i;-factor, Code-specificahty, and 
specificahty between the two similar perceptual tests, is given as 
Table III, the correlations now being reported in hierarchical order 
They are now ready for tetrad examination. But, again, only after the 
tetrad examination can we decide whether the correlations are acceptable 
as “non-overlapping” values. 
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16 Code . — 644, 

17 Code-parts .... — 



Table III. Showing correlations for 20 tests in hierarchical order, v-factor and two specificahties paitialled out 
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(8) THE PROBLEM OP FURTHER SPECIFICALITIES 

There are 14,535 tetrad differences for a table of 20 tests These were 
set down by Stephenson, and products and differences were computed 
by a well-trained and capable worker, using Cotsworth’s '^Direct 
Calculator ” 

Only some 23 of the 14,535 tetrad differences have values greater 
than 0-1000. An examination of the tetrads shows that the correlation 
Tq (for the two verbal tests, ^^Understanding Paragraphs” and Classifi- 
cation”) accounts for seven of these large values, and that the mean of 
all tetrads involving this correlation is more than five times probable 
error^'. This is a partial correlation, and its probable error is hkely to be 
larger than that for a first correlation but, even so, the two tests are 
at the opposite extremes of quahty-quantity preference — the ^^Classifi- 
cation” is a speed test of a marked kind (only four words have to be 
regarded in each test-unit, one of which is unlihe the other three), whilst 
the “Understandmg Paragraphs” is much more a power test (involving 
the regard of a long paragraph, followed by answering questions about 
the paragraph) ‘‘Speed preference” gives an advantage to the former, 
and a disadvantage to the latter test, and a misbalance of this kind 
frequently leads to specificahty for the two tests concerned. It thus 
seems allowable to discard tetrads which involve this correlation Tq . 
(We could, if need be, re-score the two tests, penahsing for “speed” m 
the one case, and allowing extra marks for it in the other, and so remove 
the disturbance ) 

Finally, one test, that of “Fitting Shapes,” can be considered to 
account for nearly all other tetrad differences greater than 0*1000, the 
correlations of this test with tests numbered 2, 7, 9, 10 and 17 being 
particularly concerned.. It is of mterest that these tests amongst them- 
selves appear to show some shght signs of a group factor, on the border- 
line of sigmficance All these tests mvolve “spatiahty,” and either this 
or speed preference could account for a group factor. If test No. 5 
(“Fitting Shapes”) was the most highly saturated of a set of tests in- 
volving such a group factor, then the data we have obtained are ex- 
plicable. It would seem acceptable to omit the test No. 5 from tetrad 
consideration. At worst it is no sin to omit one test from a battery of 
so many, even were there no readily acceptable explanation to be offered 
to the specificahty that it entails 

After removing the test No. 5, and all tetrads involving the corre- 
lation rg ig (and these only), there remain 11,366 positive tetrad differences, 

* Using an approximate probable error, given by 0. Spearman, A'bihi%e& of Man, 
Appendix, p x, formula 14 
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with frequency distribution given m Fig. 4 This is the first set of tetrads 
that are offered as those obtained for non-overlapping tests and that can 
receive the statistician’s attention 


(9) STATISTICAL EVALUATION OE RESULTS 

We have first to determine the constants of the distribution of the 
170 correlation coefficients Grouping m intervals of 0-05, we have 

f = 0-41363 (0-41367 by actual averaging of separate r’s), 
cr^= v7i2= 0-087268; 

/xg = 0-0076157 ; = -0-00016834 , = 0-00015647 , 

ft = 0 064157 ; ft = 2 6978 , ft = 11 (approx )*. 

(These are the values after Sheppard’s corrections had been applied 
The uncorrected values were 


= 0-088398 , = 0-007824 ; jUg = - 0 00016834 , 

1^4 = 0-00016623; ft = 0-05917, ft = 2-7219 ) 


Accordingly from the Spearman-Holzinger formula (9) 


ft2 = i|f2(l-r)2-|- 




where iV == no. of cases (300) and n == no. of tests (19) 


= 0-00079937, 
dt = 0-02827. 

[Taking r - 0-41367, - 0-0282612.] 

In order to be able to corapare this '"theoreticar^ value with our 
‘^observed” result (to be given later) we must determine its probable 
error/’ For this purpose we have employed the following formulae, given 
in the article of Karl Pearson and Margaret Moul(i)t: 

^ [(1 - - 2^2 (1 - 3f2) + 4fja3 -f- -i- (^ - 2) f (1 - f)^ (2 d- nf)] 

= 0*0468664 (p = no. of correlation coefOlcients == 170), 

^ [(1 - + 2 (1 + r-2) jn* - 4fftia/] 

(ft = 11, approx.) 

= 0-00000044839; 


ToMes Statieticians and BiometncianSf vol. i, Table XL T T (5), p 78, 
t Pp. 258, 259, 260. We Have written no of correlation coefficients, and of 

tests, reversing Pearson’s notation, for the sake of uniformity witb the Spearman-Holzinger 
formula. 
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{Sf S/Ij} = ^ [- if (1 - P) ^ - 2 (1 - 3f2) ^3 + 4%] 
= - 0-00000039295, 

= p2 (1 - r) (1 - 2f) + 


16 / 6f(l-f)^2 

+ ^2[1+- 


f^2 


+ % [r (1 - (1 - 2r) + (i + {S^" V 2 } 


6f (1 — f)'^ 

¥■ 


:p-i 

3(l-~-2f) 

= 0'000000057591106; 

/. <7^^2 = 0*00023998, 

assuming approx, normal distribution 

((1), p. 268) 

- 0*0038349; 

•. p E. of dt — 0*0025866, 

Thus the ^'theoreticar^ value, = 0*02827 ± 0*0025866, 

Turmng now to the observed frequency distribution of tetrads, 
grouped m subranges of 0*005, we have the following distribution 
constants* 

Median (Quartile of Symmetrical Distribution) = 0*0214, 

= 0*031289, = 0*000979, - 0*00000269749 ; 

^2 == ^ = 2*81446 (a platykurtic curve). 

1^27 

As the tetrad differences must he numerically between — 1 and + 1, 
the best-fitting curve must be a limited range symmetrical curve. Since 
P2 < 3, the best-fitting curve is a T 3 rpe II a Pearson curve^, with equation 

y = yo[i--2 ) . 

Here m = = 13-669, 

a® = = 1188 [fi 2 = 39-16 m terms of umt of 

^ P 2 “ grouping (0*006)] ; 

a = 34*468 (or 0*17234 m terms of size of tetrads), 

A, N X V {2')n + 2) __ 22 >7\^\ 

Vo - a2^m+i {p (m + l)}a 

= 1412. 


♦ Tables for Statisticians and BiometncianSf Part i, p. ixiii. 
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Hence the equation to the best-fitting curve is 

/ >y>2 \ 13*669 

y = 1412 f 1 - (unit of grouping = 0-005). 

Or, expressed in terms of tetrad differences, 
y = 1412 (^1 - 0 172342 ) 

showing that it cuts the axis of x at the points ± 0-17234, making very 
“high” contact. 

The best-fitting normal curve 

2a- 

aV ITT 

^2 

gives the equation y = M48e~'78 32 (unit of grouping = 0*005) 

The accompan 3 ung figure (Fig 4) gives the symmetrical distribution 
of tetrad differences, with the Type II a curve (continuous hne) and 
normal curve (dotted hne) superposed. 

Applying the (P, test for goodness of fit*, we have for the Type II a 
curve, (mid-ordmates), 

^2^8 i K = 21-69494 

for 22 groups in half the symmetrical curve; 

P- 0*41764, 

— a good fit, since one sample in 2*4 would give a fit as bad or worse 
to this curve. 

For the normal curve, (areas), = 46*82078, 

P- 0*002612, 

— ^fax less good a fit, although if we look at the visual pictures of the 
two curves in the diagram we see that the normal curve does not fall 
greatly behind the Type II a curve in closeness of correspondence to the 
observed values of the tetrad differences. It is because of the large 
number of groups (22 for each half of the curve) that the numerical test 
of goodness of fit is so stringent and exacting in this case. 

^ As Professor Karl Pearson points out (d), p. 276) this test zs not wholly suitable to 
tetrad differences, since “it is based on random selection from an mffnite population, any 
member of wbicb is equally bkely to be drawn,” but it is useful m givmg us at least com- 
parative values. For the Tables, see Tables for Statisticiam arid Biomdncians, Part i, 
Table XII, p. 28. 
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1300 - 

1200 - 

1100 - 
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900 - 
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700 - 

600 - 

500 - 

400 - 

300 - 

200 - 

jlOO- 


Size of tetrads 

Fig 4 Symmetrical distribution of the tetrad differences 

Best-fittmg curve (Type II a Pearson curve) 

Best-fittmg probability curve 

(Reproduced by permission from Nature, vol cxxx, p 588, October 15th, 1932 ) 


Table IV, Distnbution of positive tetrads 


Range of 

Observed 

Type II A curve 
(mid-ordmates) 

“Normal” curve 
(mid-ordmates) 

“Normal” curve 

tetrad 

frequency 

yo = 1412 

^0 = 1448 

(areas) 

0 000-0 005 

1472 

1408 

1443 

14418 

0 005-0-010 

1383 

1376 

1407 

1405 6 

0 010-0 015 

1300 

1314 

1337 

1335 8 

0 015-0 020 

1218 

1225 

1238 

1237 0 

0 020-0 025 

1037 

1116 

1118 

1117 9 

0 025-0 030 

968 

992 

984 

984 7 

0 030-0 035 

832 

861 

844 

843 3 

0 035-0 040 

731 

728 

706 

706 4 

0 040-0 045 

618 

699 

576 

576 0 

0 045-0 050 

493 

480 

457 

458 0 

0 05(M) 055 

383 

373 

354 

355 0 

0 065-0 060 

311 

281 

268 

268 2 

0 060-0 065 

193 

205 

197 

197 6 

0 065-0 070 

163 

145 

141 

1418 

0 070-0 075 

109 

99 

99 

99 3 

0 075-0080 

65 

64 

67 

67 7 

0 080-0 085 

33 

40 

45 

45 0 

0 085-0 090 

24 

24 

29 

29 2 

0 090-0 095 

11 

14 

18 

18 5 

0 095-0 100 

8 

7 

11 

114 

0 100-0 105 

4 

4 

7 

68 

Over 0 105 

— 

1 

10 

90 

Total 

11,356 

11,356 

11,356 

11,356 
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The above graduations were earned out m terms of mid-ordmates 
in order to be able to plot the curves. For the normal curve, areas were 
also calculated In the case of the Type II a curve, Simpson’s quadrature 
formula, viz. 

1 

to change ordinate values mto areas, was tried, but it made a difference 
of only 1*5 in the two largest groups, and less than 1-0 in all the other 
groups. Hence for our present purpose the correction was unnecessary*. 
Sheppard’s corrections, for high contact, had already been apphed in 
determining the moments of the distribution 

If m be taken as 14, the nearest whole number to 13*669, the equation 
to the curve becomes 

y = 1428 (l - 5 . 1 Y 2342 ) • 

For this curve == 31*71508, therefore P = 0*07749 — a less good fit. 

The one constant of our observed frequency-distribution which we 
can compare with the previously determined ‘theoretical” value is 

cr^ = 0*031289. 

The excess of this over the theoretical value (0*02827) is 0 003019, i.e 
1*167 (or l^) times the “probable error” of the latter value (0*0025886). 
This mdicates a good correspondence of observation with theory 

We may therefore conclude that, so far as this one frequency-constant 
IS concerned, the criterion in the Theory of Two Factors satisfactorily 
passes the test of experience. 

(10) A SUBSIDIABY TEST 

The frequency-distribution of tetrads for 16 of the tests, omitting 
tests a, 6, 0 , d and y of Table III, was worked out, using the same unit 
of grouping, 0 005. For these 4095 positive tetrads, 

o*j = 0 03116, 

a result no better than that for 19 tests. 

The other constants were 

0*000971095, - 0*000002486, 2*6362, 

* The high value of for the normal curve is mainly due to the “tail” of the distri- 
bution, viz, 9 for the 22zid group “over 0 105,” although this represents no more than 
0*8 per 1000 distnbution. Neglecting this tad, we find x® for 21 groups =37*82078, giving 
P =001913, 




(11) CRITICISMS MET 

It lias been pointed out by Professor Karl Pearson ((i), p. 247), that 
“if represents tbe correlation between the 5th and ith variates in an 
indefinitely large population which is going to be sampled, Tst the corre- 
sponding correlation in any particular sample, and is the mean value 
of Tst for many samples; then r^t is not equal to Assuming normal 
distribution of the variates, an approximate expression of the relation- 
ship (lO) IS 

where N is the size of the sample 

Moreover “the variation of r round p due to random samphng is of 
the order of its standard deviation, namely Ij's/N'' Hence in writing r 
in the place of p, as we must since we do not know />, and as Spearman 
and Holzinger do in deducmg their formula, terms of the order ljN\/N 
are neglected. If N is small this neglect may be serious. By applying 
our tests to 300 cases we escape the main force of this criticism. 

A second criticism of a mathematical nature is that of Professor E. B. 
Wilson (11) and Professor H. T. H. Piaggio(i2), that g is not determinate. 
But it has been shown by Professor Spearman (13) that this mdeterminacy 
diminishes as the number of tests is increased, and Dr J 0. Irwin (14) has 
proved “that g is not determinate but that its determinacy can be made 
as small as we please by taking a sufficient number of tests.” We may 
fairly assume that the 19 tests employed in the present research are a 
large enough number to satisfy this condition. 

We are still faced with the further ob 3 ection of Professor Wilson that 
“this uniqueness (of g) is relative to the set-up, since, if we constructed 
artificial tests by taking linear combinations of the marks in the original 
tests in such a manner as to preserve the hierarchical conditions, the 
new g would not necessarily be the same as the old” (quoted from J. 0 
Irwm(i4), p. 368). Nevertheless we need not as psychologists be greatly 
disturbed by this objection. 

The relation between the tetrad criterion and the “correlation be- 
tween columns” (hierarchical order of correlation coefficients) criterion 
has recently been reconsidered in an mteresting paper by Dr J. C, 

B. &T. 


15 
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Maxwell Garnett (15) One of the outcomes of his discussion seems to be 
the propounding of a quantity y which he conceives to be related to g 
as follows measures how much the individual tries throughout the 
set of tests, y measures how much good his trying does ”( (15), p. 372). But 
he admits that this is ''only a rough guess and probably a wrong one.” 
The equation connecting the two quantities is 

g^G-\'ky, 

where G is the most probable value of g for the given mental tests of 
the same individual, and "i; is to be determined so that the standard 
deviation of y is unity.” The argument is directly hnked up with the 
work of Wilson and Piaggio But since h tends towards zero as the 
number of tests is increased (Spearman and Irwin), the interpretation 
of y is not without difficulty. Dr Maxwell Garnett writes: “ . . there 
seems no reason why y should not be the same for the same individual 

every set of mental tests. If, for example, y measured the individual’s 
'power of concentration’ — ^perhaps how much 'mental energy’ he renders 
available by a unit 'effort of will ’ — y might be independent of his per- 
formances . , g'w m any particular set of tests. Then g might measure 
how much 'mental energy’ he manifests in the set of tests, so that g 
would depend on y and would be common to all the tests of the set” 
(p.371). 

We hope that further analysis of our data may throw hght on this 
and cognate problems, but the work must be postponed to a subsequent 
article. The main purpose of our research has been achieved, namely to 
establish Professor Spearman’s Theory of Two Factors on an adequate 
statistical basis. We have also found that a Type Ha Pearson curve 
fits the distribution of tetrads for our 19 tests very closely. 


Note The ‘‘theoretical” curve (Type II a) to be expected, assuming the truth of the 
Two Tactor Theory (Spearman), has the equation 


See Nature, 1934, cxxxni, 724. 
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CHAPTER XIV 


RECENT DEVELOPMENTS OF STATISTICAL METHOD 
IN PSYCHOLOGY* 

[Reprinted j&'om the autumn Occupational Psychology^ 1938] 

By GODFREY H. THOMSON 

A GREAT deal of the mathematical mterest in applied psychology arises 
from the theory of factors. The incentives to such a theory seem to me to 
be of two kinds, theoretical and practical; and the opimons we are hkely 
to hold regarding it depend upon whether we are more dominated by the 
theoretical or the practical aspect. 

(1) VOCATIONAL ADVICE 

One important practical incentive is the hope that factors may be 
of use m vocational and educational guidance and selection. The typical 
form which these take, in so far as they are based upon the admimstration 
of tests, is to find the correlation coefl3.cients of the tests with each other 
and with the occupation From the candidate’s scores the ordinary 
regression equation will then give the “best” prediction of his probable 
ability m the occupation, m the sense that the squares of the discre- 
pancies between the predictions and the facts, when summed over many 
cases, are minimised. To make such predictions more accurate, an 
extensive search is required for the right tests to add to the battery to 
increase the multiple correlation. The expense of such work, the length 
of time required by “follow-up” experiments, and the difficulty of 
getting adequate measures of the success of the candidates m their 
occupations, together with the great vanabihty of the human machine, 
are the main obstacles to improvement m such prediction. 

The practical hope of factorists has been that somehow factors would 
enable better predictions to be made. Now it should at once be pointed 
out that maihemaUcally this is impossible If the use of factors turns 
out to improve vocational advice it will not be for any mathematical 
reason. For vocational or educational prediction means projecting a 
point given by n obhque co-ordmate axes called tests on to a vector, 
representing the occupation, whose direction cosines are known but 

* A paper read to the Royal Society on March 24th, 1938, and published by kind 
penmsaion of the Editor of the Proceedings 
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whicL. IS not in the ^-space of the tests. Such estimation requires some 
assumption to be made about the candidate’s ability along the extra 
dimension orthogonal to the test-space, and nothing whatever can do 
away with the need of such an assumption The regression method 
assumes that m this totally unexplored direction the candidate is 
average. 

The use of factors, whether orthogonal or oblique, merely means 
referring the point in question to a new set of co-ordinate axes called 
factors instead of to the original test-scores, a procedure which may well 
have advantages of convemence for psychological thinking but cannot 
define the point any better, and unless care is taken may make matters 
worse (1), nor does the change of axes in any way facihtate the projection 
on to the occupation vector. 

More Factors than Tests 

Moreover, the task of carrying out prediction with the aid of factors 
as go-betweens is rendered more difhcult by the circumstance that the 
popular systems use more factors than there are tests, so that the factors 
themselves have to be estimated. In addition, it is usual to estimate only 
what are called the common factors, throwmg aside the factors which 
are umque to one test only If there is any guarantee that these aban- 
doned portions of the test- variance are uncorrelated with the occupation 
to be predicted, then no harm is done. But the circumstances in which 
this guarantee can be given are precisely those circumstances m which a 
direct prediction without the intervention of factors can easily be made. 

Maximising and Minimising Specifics 

Systems which mimmise the number of common factors have the 
pecuharity of thereby maximising the variance of the specific factors 
This maximisation of the specific variance, the part of the test-scores 
which is not used, must, I think, dimimsh the usefulness of such systems 
for vocational guidance. There is therefore a peculiar interest in the 
proposal made by M. S. Bartlett (2) to estimate factors, not on the 
regression prmciple but on the principle of minimising the squares of the 
specific factors summed over the tests The connection between Bartlett’s 
estimates and the ordmary regression estimates has been deduced ( 3 ); 
but so far there has not been time for any practical trial of this new 
method. It should be noted that Bartlett accepts the number of common 
factors given him by others, so that his minimisation of the specifics 
takes place after their maximisation by Thurstone’s prmciple. 
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It should also be noted that Bartlett attains his end of minimising 
the specifics only by making, imphcitly, a different assumption regarding 
the ability of the candidate in traits which have not been measured and 
are uncorrelated with the tests. The regression method assumes that all 
the candidates are average in these, the Bartlett method involves 
assigmng to each candidate different degrees of excellence m them 
Both are assumptions, but the former is the more hkely. 

A Conflict of Principle 

There is, I think, need for further critical examination of the principle 
of minimising the number of common factors. It is defended on the 
grounds of parsimony. But this parsimony in the number of common 
factors is necessarily accompamed by prodigahty in the use of specific 
variance. The few common factors, although they describe the corre- 
lations adequately, describe the whole man very inadequately, throwing 
away as much as possible of the information given about him by the 
tests. There is, in fact, a direct conflict of principle between factor 
methods which confine themselves to reproducing the correlations, and 
methods which endeavour to use all the information, excluding only 
what may be ascribed to samphng error. 

So much for the practical side 

(2) THE THEOEETIOAL SIDE 

On the theoretical side I wish to speak briefly of three matters: 

(a) Thurstone’s conception of Simple Structure ’’ 

(b) The dependence of factorial analyses on selection 

(c) The true deduction to be drawn from the low reduced rank of 
correlation matrices. 

There is clearly a natural desire m mankind to imagine or create, and 
to name, forces and powers behmd the fagade of what is observed, nor 
can any exception be taken to this if the hypotheses which emerge explain 
the phenomena as far as they go, and are a guide to further inquiry. 

That the factor theory has been a gmde and a spur to many mvesti- 
gators cannot be denied, and it is probably here that it finds its chief 
justification. 

"‘Simple Strmture^^ 

The desire to find ^"reahties” behind the phenomena appears to be 
strong in Thurstone. His conception of “^simple structure’’ among 
factors, and his belief that when ‘‘^simple structure” is achieved the 
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factors have a significance more than that which attaches to mere 
statistical coefficients, is of the greatest interest (4). His method is to 
break up each test into two components, of which one is orthogonal to 
all the other tests, while the other or communal components he in a space 
of much smaller dimensions than the number of tests It is a striking 
fact, of which I wiU offer an explanation presently, that this is so generally 
possible. The axes of the space at which he thus arrives he rotates within 
that narrow common-factor-space, if necessary allowing them to become 
shghtly obhque, until as many as possible of them are at right angles to 
as many as possible of the origmal test- vectors It is his faith that when 
a position can be found with a certain large number of such right angles, 
the axes or factors will be found to be entities acceptable to the psycho- 
logist. 

It IS refreshing to find so strong a behef that mathematical elegance 
is bound to correspond to physical or mental entities or actualities I 
fear, however, that the factors found from different batteries by the 
strict apphcation of this mathematical principle may not correspond to 
one another. 

It should of course be recognised that Thurstone’s method is not a 
method of analysing any matrix of test-scores. It is a method of dis- 
tinguishing when a set of tests is suitable for the defimtion of primary 
factors 

It is clear that the attainment of ‘‘simple structure’’ will not be 
possible unless the battery of tests has been selected or purified It is 
desirable, therefore, to have criteria which will say rapidly from calcu- 
lations on the matrix of correlations whether “simple structure” can be 
attained. Such criteria have recently been described, in articles discussing 
boundary conditions m the common-factor-space (8). 

There may, however, exist different Thurstone batteries which define 
different and incompatible sets of factors. I think, therefore, that the 
factorial composition of any given test must at some stage or other be 
defined by the psychologist, and thereafter held invariant, for I do not 
thmk that it will naturally remain invariant If, however, such invariance 
is found to occur naturally, without undue forcing of the sets of tests, 
then this will be a very important observation. So far the evidence of 
this appears to me to be inadequate. 

Selection among Persons 

The analysis of a battery of tests into factors is very dependent upon 
the group of persons from whose scores the correlations are calculated, 
and can be changed very much by substituting a different set of persons. 



232 RECENT DEVELOPMENTS OE [pt. ii 

Karl Pearson’s fundamental formulae for changes in correlation due to 
selection have lately been put mto very convenient matrix form by A, C. 
Aitken(5), and with their aid the changes in factorial analysis due to 
selection, which might include natural selection, can be readily followed 
Such selection can create or destroy factors, and change the relationship 
between them (6). Factors are seen as flmd descriptive mathematical 
coeiBBcients, changing both with the tests used and the sample of persons, 
unless we take refuge in sheer definition based upon psychological judg- 
ment, which defimtion would have to specify the particular battery of 
tests, and the sample of persons, as well as the method of analysis, in 
order to fix any factor. This influence of selection is particularly important 
in vocational work, where the correlations between tests and occupations 
are necessarily got from selected groups, namely from men employed m 
each industry. 


Reason for Low Rank 

Lastly there is a strong tendency to be impressed by the fact that 
most matrices of mental correlation coefficients can be described by a 
comparatively small number of common factors {plus specifics), that is 
to say, that the reduced rank of such matrices tends to be low. This gives 
rise to a feehng that common factors must be important and actual 
things if they produce this remarkable effect. The fact is, however, that 
this tendency to a low reduced rank follows as a mathematical necessity if 
the causal background is structureless. Complete families of correlation 
coefficients will always show it if all possible samples of the causal back- 
ground can be taken (7) The less pronounced the structure, the stronger 
the tendency to low rank m the matrix. The reason low reduced rank is 
so noticeable among mental correlations is that in mental measurement 
almost any combination of the many small causal influences can occur, 
whereas in measurements of height, arm-length, cranium, etc , the organs 
we have to measure are forced upon us. There are no such separate 
organs in the mind 

The flux of causal influences m the background will then tend to 
make all matrices of mental correlations hierarchical. It is the de- 
partures from rank one which indicate the beginnmgs of a structure m 
the mind comparable with the organs of the body. The chief deduction 
which can be drawn from the comparatively low rank to which so many 
matrices of mental correlation coefficients can be reduced is, m my 
opinion, the conclusion that the mind of man is comparatively un- 
differentiated, protean and plastic, not that it is composed of separate 
faculties. 
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CHAPTER XV 

THE FACTORIAL ANALYSIS OF ABILITY 

THE PRESENT POSITION AND THE PROBLEMS 
CONFRONTING US* 

[Erom The British Journal of Psychology (General Section), 

Vol XXX, Part 2, October, 1939] 

By GODFREY H. THOMSON 

(1) WHY DO PSYCHOLOGISTS WANT FACTORS? 

I PROPOSE to set out what appear to be the main principles (some of them 
incompatible) of the several systems of factorial analysis which co-exist 
at the present day First, however, let us ask why psychologists want to 
have factors at all. The following reasons are given * 

(а) If factors can be so chosen that a few of them give a good approxi- 
mation to the information given by the large number of tests, there is 
obvious economy in their use. 

(б) Orthogonal factors, that is, uncorrelated traits, have the advantage 
for scientific thought that they are independent, and they lead to simpler 
formulae. It should be remarked, however, that none of the human 
traits naturally named by naive man are uncorrelated, and that he is 
usually unable to reahse the independence of the factors offered him by 
the psychologist, unable to reahse for example that a man of high v (the 
verbal factor) is just as likely to be a man of low as of high g. 

(c) There is a feehng that factors may be more enduring entities than 
the innumerable and changing tests used to find them. They come to be 
looked upon as the things in terms of which tests are described, although 
really of course it is the factors which are described m terms of tests. 

(d) It IS an easy transition to look upon the factors as actual and real. 
It is of the nature of man to deify or reify forces and powers behind 
phenomena, and we are aU subject to this urge, which is, I think, a large 
part of the explanation of why factors are so acceptable to so many of us. 

(2) THE PROBLEM OE FACTORIAL ANALYSIS 

The scores of each test being set off along a hue, these lines can be 
given directions in space at angles whose cosines are the correlations. They 
will then occupy a space of n dimensions if there are n tests, and the 

* A contribution to tbe symposium presented at the Extended General Meeting of the 
British Psychological Society held at Readmg m April, 1939. 
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population of persons will be represented by points in this space, con- 
gregated round the origin where the man who is average m every test is 
situated If standardised scores are used, the population wiU fall off in 
density equally in all directions from that point, its density contours 
being spheres. 

The problem of factorial analysis is then to choose a set of axes or 
factors, preferably orthogonal or nearly so, to replace the tests as definers 
of the space, that is of the qualities of the persons As there are innu- 
merable sets available, some principles must be adopted to select one as 
the best. '‘Best’’ may mean here best from some psychological, or from 
some mathematical, point of view, or possibly these may chck into agree- 
ment m some system acceptable to psychologists and mathematicians 
alike Among the principles which have been adopted are the folio wing"^ . 

(i) Representing the experimental facts (within the hmits of the 
errors present) by a smaller number of factors than tests. There is 
probably unammity on this point, but not on what the smaller number 
of factors are to be required to do best 

(li) Reproducing as much as possible of the whole variance with each 
successive factor (Hotelhng(6)). 

(m) Reproducing the correlations with the minimum number of 
common factors (Spearman (9), Thurstone). 

(iv) Insisting on a general factor g (Spearman, Holzinger). 

(v) Rotating the factors until they become psychologically significant 
(Thurstone (12, 13)) 

(vi) Requiring Simfle Structwe,'' i.e. certain mathematical re- 
lations between factors and tests in a battery. These reqmrements have 
led to no general factor being found in tests reputed to be saturated with g 
(Thurstone (12, 13)). 

(vu) Requiring invariance of analysis of the same test in different 
batteries, when used on equivalent samples of persons. 

(viii) Usmg factors and loadings which are reciprocal for persons and 
tests (Burt (2, 3)) 

I have placed after each, as a guide to the reader, the names of one or two of those 
most closely identified with the principle, but the classification is not of course perfect or 
complete. Kelley’s name(7) wiU be missed. He is very important, but I have not felt able 
to identify him sufficiently with any of these prmciples Stephenson’s name can accompany 
Spearman’s wherever it appears, and he is also mterested m the relationship between test 
factors and person factors (lO), though he does not make a prmciple of them reciprocity as 
Burt does. 
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(3) REPRODUCING THE VARIANCE 

The natural desire of the statistician (e g. Hotelling) is to lose as little 
information as possible He adopts therefore the second principle, using 
the principal axes of the ellipsoids which result from the density spheres 
when the test hnes are pulled into orthogonahty(6). It will of course 
require as many factors as there are tests, to reproduce all the informa- 
tion. But if, after a few factors, the greater part of the variance has been 
accounted for, the remaimng factors are neglected The statistician has 
then arrived at the best shorthand description of this battery He makes 
no claim to have arrived at factors which have any other significance, nor 
that they are invariant when tests are added to or taken from the 
battery His axes indeed are not factors at all in the sense intended by 
those who use prmciples (v) and (vii). 

There is, however, nothing to stop a worker who proceeded on these 
hnes from then adopting principle (v), and rotating his few main factors 
in their own space in the hope of making them psychologically sigmficant , 
but this has not in practice been done with '' principal components ” based 
on the whole variance 

The first few factors found by the above method will approximate 
both to the total variance and also to the correlations. But it is the 
former they do well. 

(4) REPRODUCING THE CORRELATIONS 
M%mmal Rank Methods 

Better approximation to the correlations can be made by another 
method, which depends on the fact that a matrix of correlation coefficients 
between mental tests, when suitable numbers are inserted in its diagonal, 
is of low rank, within the hunts of error. The reason for this is, in my 
belief, the complexity and plasticity of the mind, and the operation of the 
laws of chance. But whether this is the true reason or not is immaterial 
to our present argument, for the phenomenon is undoubtedly present and 
the result is that the correlations can be closely imitated by a small 
number of factors compared with the number of tests. This small number 
of factors does not, however, by any means give a good approximation to 
the whole variance but only to certain fractions called ^^communalities.’’ 
There is therefore much information lost by using only these common 
factors. The other factors — specifics — are not needed to imitate the 
correlations of this particular battery. But they may be of importance m 
predicting success m some occupation. These mimmal rank methods, 
therefore, which make much of the fact that they are parsimomous in 
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common factors, attam that parsimony only by contenting themselves 
with imitating the correlations, and giving up any attempt to reproduce 
all the information contained in the tests. Their second great weakness 
IS that since the whole number of factors exceeds the number of tests, 
each IS subject to an indeterminacy and can be estimated with less 
accuracy than can one of the prmcipal components of the former method. 

The Spearman School 

Among those who use the mimmal rank method there are two schools, 
that of Spearman (9), who discovered the fact of low reduced rank many 
years ago, and that of Thurstone(i2). The method of the former school is 
to proceed by purifying a battery of intelhgence tests until one general 
factor g is sufficient to account for the correlations. The ^^-saturations of 
the tests in this battery are then known. In more complex batteries this 
g IS always taken out first. When a second factor is suspected, a battery 
IS built up to measure it (by the residuals left after the removal of g), a 
battery which contains only these two. And so the process goes on step 
by step, a complex matrix of correlations being looked upon as made up 
by the superposition on top of the gr-hierarchy, of sub-hierarchies each 
due to a new group factor. Invariance of analysis can be gained (principle 
(vii)) by retaining for any test that gr-saturation which it had m the best 
‘‘^-battery/’ and so on with the other factors No rotation is necessary 

Holzinger’s Bifactor Method (4) is the same in principle, although it 
proceeds on more wholesale hnes. 

The Thurstone School 

In contrast with the step by step Spearman method, the Thurstone 
method is a simultaneous one. No attempt is made to reduce any battery 
by purification to rank one Instead, a large battery is analysed simulta- 
neously into a number of common factors — ^plus the specifics characteristic 
of both schools — ^by a method which involves first of all guessing the 
communahties and then taking at each stage the centroid of the residues. 
The resulting factors are devoid of psychological significance and have to 
be rotated m a search for positions where they will have such significance. 

Here Thurstone introduces the idea of '"Simple Structure,” a mathe- 
matically defiined position of the axes(i2). It is his belief that if m any 
battery “Simple Structure” can be attained the factors will then be 
recognisable as psychological entities. “ Simple Structure” is marked by 
the absence of negative saturations and the presence of many zero satura- 
tions, for it is laid down that there must be at least one zero saturation in 
each test, and several zero saturations in each factor. This excludes a 
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general factor, and Thurstone naturally therefore does not find one(i3), 
even when he analyses tests said to be highly saturated with g. Just as 
naturally Holzinger and Harman (5), analysing the same data, do find a g, 
its presence in their pattern being, as they frankly say, “due to our 
hypothesis of its existence/’ 

Alexander (1) has carried out an analysis using Thurstone’s way of 
arriving at a set of minimal rank factors, but not his hypothesis of 
“Simple Structure.” Instead, Alexander at this point passes over to the 
Spearman plan, and adopts for some of his tests analyses already known 
This throws into rehef the fact that the essential difference between 
Thurstone and Spearman is in the former’s use of “Simple Structure.” 
Spearman has no need, m his step by step method, to rotate his factors 
But if he did use Thurstone’s first analysis (as Alexander has done) he 
could then rotate to positions corresponding to the results of the step by 
step procedure. If, however, a battery of tests was put together from 
Spearman analyses, and offered for alternative analysis via “Simple 
Structure,” it would be necessary, to give a chance of agreement, to 
include several tests with nearly zero saturation in g, otherwise either 
“Simple Structure” would not be attainable, or the two methods would 
be fore-ordained to disagree. 

(5) RECIPEOCITY OF TESTS AND PEESONS 

The last principle (reciprocity of persons and tests) has been put 
forward in its rigorous form by Burt only (2, 3), although Stephenson (lO) 
has proposed to check analyses of tests and of persons by one another, 
Burt holds that those factors are the proper ones to use of which it can 
be said that the same results are arrived at whether we analyse tests or 
persons — the factors and loadings of the one analysis being the loadings 
and factors of the other. This end, however, Burt attains only by removing 
from the operation of the prmciple a factor consistmg of the average 
performance of each person m all tests, and by working with unstan- 
dardised scores and covariances instead of correlations. Actually he 
removes his “average” factor not by analysis but by selection of cases 
equal in average score'*'. On a matrix of scores which has somehow been 
centred both ways his reciprocity principle however does work. Such 
a matrix has only w ~ 1 dimensions (one factor, the average, having 
been removed) and Burt uses the principal axes of its elhpsoids. His 

♦ I would bke to take this opportunity of withdrawing lines 33 to 35 on page 290 of 
my hook TAe Factorial Analysis of BuTnan Ability for I now see that smce Burt chose 
his suh-sample of persons to be not only equal m average to on© another, but equal to the 
average of all, those hnes are irrelevant. 
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factors are therefore free from ‘‘indeterminacy/’ He does not, however^ 
rotate them but interprets them as they are, with their numerous 
negative loadmgs, a procedure which has passed muster in the analysis of 
temperament to which alone so far he has applied it, but would arouse 
opposition were it apphed to the analysis of more ordinary mental test- 
scores. His use of raw scores just as they stand is certainly wrong: but 
if a suitable set of umts could be discovered — I have suggested one 
based on the samplmg theory (ii) — ^the practice of analysing covariances 
instead of correlations would have much to commend it. 

(6) VARIOUS OTHER MATTERS 

There remain several matters which I have space only to mention. 
For a long time workers were content to analyse batteries of tests into 
factors, and did not proceed to the practical estimation of these factors 
in individuals Now that this is beginmng to be done, a reahsation is 
growing of how uncertain such estimates are, as a result of the mathe- 
matical weakness of postulating in minimal rank systems more factors 
than tests. It is also coming to be reahsed that to estimate factors, and 
from these to estimate proficiency in an occupation, is a roundabout 
procedure when the latter can be estimated direct. 

Finally, much has been done to illustrate the influence on factors of 
selection among the persons, and also of training and maturing. In 
connection with selection it has been made clear that factors are bound 
to change, emerge, and disappear with the changmg sample, and there- 
fore also with the generations of man, and Price (8) has indicated how 
homogamy can influence the factorial make-up of successive generations 
Factors are statistical coefficients, changing with the sample and the 
conditions and dependent upon stated assumptions: but with defined 
conditions and assumptions they are most useful as descriptive terms. 

(7) A SUMMING UP 

In summing up I remind myself first of all that neither Thurstone 
nor any keen follower of his has been present at this symposium to 
defend the idea of “Simple Structure.” Let me therefore for one para- 
graph hold a temporary brief on his behalf. 

I recently heard Professor Dirac uphold, before the Royal Society of 
Edinburgh, the thesis that when a mathematical physicist finds a mathe- 
matical solution or theorem which is particularly beautiful — and every 
mathematician knows what mathematical beauty is — ^he can have con- 
siderable confidence that it will prove to correspond to something real m 
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physical nature. Something of this same faith seems to me to he behind 
Professor Thurstone’s trust in the coincidence of '"Simple Structure’’ m 
the matrix of factor loadings with psychological sigmficance in the factors 
thus defined. This is of course not all. The conditions laid down in 
"Simple Structure” are laid down in order to remove the embarrassing 
number of degrees of freedom which permit the factor axes to be rotated 
like a Catherine wheel. They clamp the axes at one pomt (unless very 
unusual conditions prevail m the battery) if indeed that point can be 
reached, which is not necessarily the case in every battery. If it cannot 
actually be reached it can be approached as nearly as possible And 
Thurstone also gives, in pp. 71 and 72 of Pnmary Mental AhihUes^ and 
perhaps elsewhere, what one might call his common-sense reasons for 
thinking it plausible that numerous zeros will occur among the loadings. 
Moreover, we must remember that he has embarked on a campaign of 
formmg augmented sub-batteries round tests chosen from his original 57, 
to obtain better definition of his factors, and has obtained what one must 
admit to be rather encouraging results in his study of the perceptual 
factor{i4). 

The disagreement between Thurstone and Spearman as to the general 
factor g is perhaps the most important point of controversy, as it 
IS certainly one of the most easily grasped by the non-mathematical 
psychologist and one of the most disquieting to him. Professor Spearman 
has defended the general factor which will always be associated with his 
own name; but I think (crossing the court now to speak on his side of 
the case) that he might have done so more fundamentally than he has. 
For the objections he has raised to Thurstone’s work might conceivably 
all be overcome. A longer time could be given to the tests. Product- 
moment instead of tetrachoric correlations could be calculated. Error 
could be reduced by greater care, and by using larger and better samples 
of subjects. Yet stiU Thurstone rmght be able — mdeed, with a properly 
chosen battery, I think he almost certainly would be able — ^to attam 
"Simple Structure” among his loadings, and the complaint that a dis- 
membered g was merely bemg submerged m a sea of error woidd no longer 
be justified, at any rate as far as the submergence was concerned. Surely 
the real defence of g is simply that it has proved useful. It still remains 
to be seen whether Thuxstone’s primary factors will prove equally useful, 
A jury in this country would probably to-day give a verdict to Spearman; 
a jury in another place might give a verdict to Thurstone. The larger jury 
of the future will, I think, decide by noting which system has proved more 
useful in the hands of the practising psychologist. 

I myself lean at the moment more towards Spearman’s g and his 
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later group factors than I do to Thurstone’s, since they seem to me more 
m accord with the ideas of my own Sampling Theory. On that theory g 
IS as it were the whole mind, and tests are part of g, not ^ part of the tests 
And were that mind entirely undifferentiated, structureless, g would be 
the only factor we need. As the complexity of the mind, or the com- 
plexity of the upper brain, is organised (partly by the maturing of 
hereditary bonds, mainly I fancy by education and hfe) and integrated 
into ‘Spools,’’ clusters,” call them what you will, so additional factors, 
additional descriptive coefficients, are needed. It seems to me at present 
wise to retain one coefficient to express the general depth starting from 
which the integration, the deepening into subpools, has gone on. But I 
am not sure, and think the better course is to await further papers from 
workers in Thurstone’s school. I think it possible that there will come a 
stage when practical progress will be most facilitated by a j&rm voluntary 
agreement among psychologists that certain well-known tests have such 
and such a factorial composition, are not to be changed, and may be 
used to fix some of the factorial axes in a battery The sample of persons 
would also have to be defined and different factorial compositions might 
be given for children and adults, for hterates and illiterates, etc., etc. 
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APPENDIX I 


TABLES 


1. Fechner’s Fundamental Table. 

2. Urban’s Tables for the Constant Process. 

3. Table of Muller-Urban Weights 

4. Eeciprocals of where -f g = 1. 

5. Eioh’s Checking Table for the Constant Process. 


1. Fechner^s Fundamental Table 


p 

7 

P 

7 

P 

7 

0 60 

0 0000 

0 67 

0 3111 

0 84 

0 7031 

0 61 

0 0177 

0 68 

0 3307 

0 85 

0 7329 

0 52 

00355 

0 69 

0 3506 

0 86 

0 7639 

0 53 

0 0532 

0 70 

0 3708 

0 87 

0 7965 

0 54 

0 0710 

0 71 

0 3913 

0 88 

0 8308 

0 55 

0 0888 

0 72 

0 4121 

0 89 

0S673 

0 56 

01067 

0 73 

0 4333 

0 90 

0 9062 

0 57 

01247 

0 74 

0 4549 

0 91 

0 9480 

0 58 

01427 

0 75 

0 4769 

0 92 

0 9935 

0 59 

01609 

0 76 

0 4994 

0 93 

1 0435 

0-60 

01792 

0 77 

0 5224 

0 94 

1 0993 

0 61 

0 1975 

0 78 

0 5460 

0 95 

1 1630 

0-62 

0 2160 

0 79 

0 5702 

0 96 

1 2380 

0 63 

0 2346 

0 80 

0 6951 

0 97 

1 3300 

0 64 

0 2535 

0 81 

0 6208 

0 98 

14520 

0 65 

0 2725 j 

0 82 

0 6473 

0 99 

1 6450 

0 66 

0 2916 

0 83 

0 6747 

100 

00 


If 2 ? is < 0*5, look in the Table not for f but for \ and take 
y negative. Thus the y for f = 0*25 is — 0-4769. 

This Table is less generally useful than Sheppard’s Tables of the 
Probability Integral, Tables I and II of Pearson’s Tables for StaUshaans 
and Biometncians (Cambridge University Press). Table I there differs 
from this only by a factor 1 / 2 : but gives many more values and to more 
decimal places. 
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2 TJrharCs Tables foi the Constant Process^ 

From Archiv f d ges. Psychol, 1912, xsiv 240 — 241*. 



W 

7 W 

2 W 

22 W 

27 W 

3 W 

32 W 

37 W 

4 W 

42 w 

iy W 

0 50 

i 0000 

0 0000 

2 0000 

4 0000 

0 0000 

3 0000 

9 0000 

0 0000 

4 0000 

16 0000 

0 0000 

0 51 

0 9993 

0 0177 

1 9996 

3 9991 

0 0354 

2 9993 

8 9980 

0 0531 

3 9991 

15 9965 

0 0708 

0 52 

0 9991 

0 0355 

1 9982 

3 9963 

0 0709 

2 9972 

8 9917 

0 1064 

3 9963 

15 9853 

01419 

(bSS 

0 9980 

0 0531 

1 9959 

3 9918 

0 1062 

2 9938 

8 9816 

0 1593 

3 9918 

15 9672 

0 2124 

0 54 

0 9964 

0 0707 

I 9928 

3 9855 

0 1415 

2 9891 

8 9674 

0 2122 

3 9855 

15 9421 

0 2S30 

0 55 

0 9943 

0 0883 

1 9886 

3 9772 

0 1766 

2 9829 

8 9487 

0 2649 

3 9772 

15 9088 

0 3533 

0 56 

0 9918 

01058 

19836 

3 9671 

0 2116 

2 9753 

8 9260 

0 3175 

3 9671 

15 8685 

0 4233 

0 57 

0 98SS 

0 1233 

1 9776 

3 9551 

0 2466 

2 9663 

8 8990 

0 3699 

3 9551 

15 8205 

0 4932 

0 58 

0 9853 

0 1406 

1 9706 

3 9413 

0 2812 

2 9560 

8 8679 

0 4218 

3 9413 

15 7651 

0 5624 

0 59 

0 9814 

0 1579 

1 9627 

3 9254 

0 3158 

2 9441 

8 8322 

0 4737 

3 9254 

15 7018 

0 6316 

0 60 

0 9768 

0 1750 

1 9537 

3 9074 

0 3501 

2 9306 

8 7916 

0 5252 

3 9074 

16 6296 

0 7002 

0 61 

0 9720 

0 1920 

1 9440 

3 8881 

0 3839 

2 9161 

8 7482 

0 5759 

3 8881 

15 5523 

0 7679 

0 62 

0 9686 

0 2088 

1 9332 

3 8663 

0 4176 

2 8997 

8 6992 

0 6263 

3 8663 

15 4653 

0 8351 

0 63 

0 9607 

0 2254 

19214 

3 8429 

0 4508 

2 8822 

8 6465 

0 6762 

3 8429 

15 3715 

0 9015 

0 64 

0 9542 

0 2419 

1 9084 

3 8168 

0 4838 

2 8626 

8 5878 

0 7257 

3 8168 

15 2072 

0 9676 

0 65 

0 9473 

0 2581 

1 8945 

3 7890 

0 5163 

2 8418 

8 5253 

0 7744 

3 7890 

15 1562 

1 0325 

0 66 

0 9S9S 

0 2741 

1 8797 

3 7594 

0 5481 

2 8196 

8 4586 

0 8222 

3 7594 

15 0376 

1 0982 

0 67 

0 9317 

0 2899 

1 8634 

3 7268 

0 5797 

2 7951 

8 3853 

0 8696 

3 7268 

14 9072 

1 1594 

0 6 S 

0 9232 

0 3053 

1 8464 

3 6929 

0 6106 

2 7697 

8 3090 

0 9159 

3 6929 

14 77J5 

1 2212 

0 69 

0 9140 

0 3205 

1 8280 

3 6561 

0 6409 

2 7421 

8 2262 

0 9614 

3 6561 

14 6243 

12818 

0 70 

0 9043 

0 3351 

1 8085 

3 6170 

0 6706 

2 7128 

8 1383 

1 0059 

3 6170 

14 4682 

1 3412 

0 71 

0 8939 

0 3498 

1 7878 

3 5755 

0 6996 

2 6816 

8 0449 

1 0493 

3 5755 

14 3021 

1 3991 

0 72 

0 8830 

0 3G39 

1 7659 

3 5318 

0 7277 

2 6489 

7 9466 

1 0916 

3 5318 

14 1274 

1 4555 

0 73 

0 8713 

0 3775 

1 7426 

3 4852 

0 7551 

2 6139 

7 8417 

1 1326 

3 4852 

13 9408 

1 5101 

0 74 

0 8590 

0 3908 

1 7180 

3 4300 

0 7815 

2 5770 

7 7310 

1 1723 

3 4360 

( 13 7440 

1 5630 

0 75 

0 8460 

1 0 4035 

1 6921 

3 3842 

0 8070 

2 5381 

7 6144 

12104 

3 3842 

13 5366 

; 1 6139 

0 76 

0 8323 

; 0 4157 

1 6646 

3 3293 

0 8313 

2 4970 

7 4909 

1 2470 

3 3293 

1 13 3171 

1 6626 

0 77 

0 8179 

' 0 4273 

1 6357 

3 2714 

0 8545 

2 4536 

7 3607 

1 2818 

3 2714 

’ 13 0858 

1 7090 

0*78 

0 8025 

0 4382 

1 6051 

3 2102 

0 8764 

2 4076 

7 2220 

] 3146 

3 2102 

1 12 8406 

1 7527 

0 79 

0 7865 

0 4484 

1 5729 

3 1459 

0 8969 

2 3594 

i 7 0782 

1 3453 

3 1459 

12 5835 

! 1 7933 

0 80 

0 7695 

0 4579 

1 5390 

3 0780 

1 0 9159 

2 3085 

1 6 9255 

1 3738 

Z 0780 

12 3120 

i 18317 

0 81 

0 7515 

0 4665 

1 5031 ' 

3 0061 

0 9331 

2 2546 

1 6 7638 

i 1 3996 

3 0061 

12 0245 

! 1 8662 

0 82 

0 7327 

0 4743 

1 4653 

2 9307 

0 9485 

21980 

I 6 5940 

1 4228 

2 9307 

11 7227 

1 1 8970 

0-83 

0 7129 

0 4810 

1 4257 ! 

2 8515 

0 9619 

21386 

6 4158 

14429 

2 8515 

11 4059 

1 1 9239 

084 

0 6921 

0 4866 

1 3842 

2 7683 

0 9732 

2 0762 

6 2287 

1 4598 

2 7683 

11 0733 

1 9464 

0 85 

0 6697 

0 490S 

1-3394 

2 6788 

0 9816 

2 0091 

6 0273 

1 4725 

2 6788 

10 7152 

1 9633 

0 86 

0 6463 

0 4937 

1 2927 

2 5853 

0 9875 

1 9390 

5 8170 

14812 

2 5853 

10 3413 

1 9749 

0 87 

0 6215 

0 4950 

1 2430 : 

2 4860 

0 9900 

1 8645 

6-5935 

1 4851 

2 4860 

9 9440 

1 9801 

0 88 

0 5953 

0 4946 

1 1907 

2 3813 

0 9892 

1 7860 

5 3580 

1 4838 

2 3813 

9 5253 

1 9784 

0 89 

0 5673 

0 4920 

M346 

2 2692 

0 9840 

17019 

5 1056 

14760 

2 2692 ' 

9 0766 

1 9680 

0 90 

0 5376 

0 4871 

1 0751 

2 1502 

0 9743 

16126 

4 8380 

14614 

2 1502 

8 6008 ' 

1 9485 

0 91 

0 5059 

0 4796 

10118 

2 0236 

0 9592 

16177 

4 5531 ! 

1 4388 

2 0236 ' 

8 0944 

1 9184 

0 92 

0-4718 

0 4687 

0 9435 

1 8871 ’ 

0 9374 

14153 

4 2459 i 

1 4061 

1 8871 

7 5483 

1 8743 

0 93 

0 4351 

0 4540 

0 8702 

17403 

0 9080 

1 3052 

3 9157 

1 3620 

1 7403 

6 9613 

1 8160 

0‘94 

0 3954 

0 4346 

0 7907 

1 5814 

0 8692 

1 1861 

3 5582 

1 3039 

1 5814 

6 3258 

1 7385 

0 95 

0 3519 

0 4093 

0 7038 

1 4076 

0 8185 

10557 

31671 

1 2278 

14076 

5 6304 

1 6370 

0 96 

0 3036 

0 3759 

0 6073 

1-2146 

0 7518 

0 9109 

2 7328 

1 1277 

1 2146 

4 8582 

1 5036 

0 97 

0 2469 

0 3282 

0 4936 

0 9871 

0 6564 

0 7403 

2 2210 

0 9847 

0 9871 

3 9485 

1 3129 

0 98 

0-1881 

0 2732 

1 0 3762 

0 7525 

0 5463 

0 6644 

1 6931 

0 8195 

0 7525 

3 0099 

10926 

0 99 

0-1127 

0 1854 

1 0 2254 

0 4508 

0 3708 

t 0 3381 

10142 

0 5661 

0 4508 

1 8030 

0 7415 


* With three corrections, two of which were made by Urban in the Praxis der Kon- 
sianzmetTiode, and the third by Bich in Amer Journ, Psychol 1918, xxix 121. The last 
was also rediscovered by the Cambridge XJniv Press proof reader 
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2. TJrhan^s Tables for the Constant Process {contd,). 

From Archiv f d ges Psychol 1912, xxiv 240 — 241 


p 

5 W 

5‘ W 

5yW 

6 W 

62 TF 

67 W 

7 W 

72 w 

7yW 

0 50 

5 0000 

25 0000 

0 0000 

6 0000 

36 0000 

0 0000 

7 0000 

49 0000 

0 0000 

0 51 

4 99S9 

24 9945 

0 0885 

5 9987 

35 9921 

0 1062 

6 9985 

48 9892 

0 1239 

0 52 

4 9954 

24 9770 

01773 

5 9945 

35 9669 

0 2128 

6 9936 

48 9549 

0 2483 

0 53 

4 9898 

24 9488 

0 2655 

5 9877 

35 9262 

0 3185 

6 9856 

48 8996 

0 3716 

0 54 

4 9819 

24 9095 

0 3537 

5 9783 

35 8697 

0 4251 

6 9747 

48 8266 

0 4960 

0 55 

4 9715 

24 8575 

0 4415 

5 9658 

35 7948 

0 5298 

6 9601 

48 7207 

0 6181 

0 56 

4 9589 

24 7945 

0 5291 

5 9507 

35 7041 

0 6349 

6 9425 

48 5972 

0 7408 

0 57 

4 9439 

24 7195 

0 6165 

5 9327 

35 5961 

0 7398 

6 9215 

48 4502 

0 8631 

0 58 

4 9266 

24 6330 

0 7030 

5 9119 

35 4715 

0 8436 

6 8972 

48 2807 

0 9842 

0 59 

4 9068 

24 5340 

0 7895 

5 8882 

35 3290 

0 9474 

6 8695 

48 0866 

1 1053 

0 60 

4 8842 

24 4212 

0 8753 

5 8611 

35 1666 

1 0503 

6 8380 

47 8656 

1 2254 

0 61 

4 8601 

24 3005 

0 9599 

5 8321 

34 9927 

1-1518 

6 8041 

47 6290 

1 3438 

0 62 

4 8329 

24 1645 

1 0439 

5 7995 

34 7969 

1 2527 

6 7661 

47 3624 

14615 

0 63 

4 8036 

24 0180 

1 1269 

5 7643 

34 5859 

1 3523 

6 7250 

47 0753 

1 5777 

0 64 

4 7710 

23 8550 

1 2094 

5 7252 

34 3512 

1 4513 

6 6794 

46 7558 

1 6932 

0 65 

4 7363 

23 6815 

1 2906 

5 6836 

34 1014 

1 5488 

6 6308 

46 4157 

1 8069 

0 66 

4 6992 

23 4962 

1 3703 

5 6391 

33 8346 

1 6444 

6 5790 

46 0526 

19184 

0 67 

4 6586 

23 2925 

14493 

5 5902 

33 5412 

1 7391 

6 5219 

45 6533 

2 0290 

0 68 

4 6161 

23 0805 

1 5265 

5 5393 

33 2359 

1 8319 

6 4625 

45 2378 

2 1372 

0 69 

4 5701 

22 8505 

1 6023 

5 4841 

32 9047 

1 9227 

6 3981 

44 7870 

2 2432 

0 70 

4 5213 

22 6065 

1 6765 

5 4256 

32 5534 

2 0118 

6 3298 

44 3087 

2 3471 

0 71 

4 4b94 

22 3470 

1 7489 

5 3633 

32 1797 

2 0987 

6 2572 

43 8001 

2 4484 

0 72 

4 4148 

22 0740 

18193 

5 2978 

31 7866 

2 1832 

6 1807 

43 2650 

2 5471 

0 73 

4 3565 

21 7825 

1 8877 

5 2278 

31 3668 

2 2652 

6 0991 

42 6937 

2 6427 

0 74 

4 2950 

21 4750 

1 9538 

5 1540 

30 9240 

2 3446 

6 0130 

42 0910 ! 

2 7353 

0 75 

4 2302 

21 1510 

2 0174 

5 0762 

30 4574 

2 4209 

5 9223 

41 4560 

2 8243 

0 76 

41616 

20 8080 

2 0783 

4 9939 

29 9635 

2 4940 

5 8262 

40 7837 

2 9096 

0 77 

4 0893 

20 4465 

2 1363 

4 9072 

29 4430 

2 5635 

5 7250 

40 0751 

2 9908 

0 78 

4 0127 

20 0635 

2 1909 

4 8152 

28 8914 

2 6291 

5 6178 

39 3245 

3 0673 

0 79 

3 9324 

19 6618 

2 2422 

4 7188 

28 3129 

2 6907 

5 5053 

38 5370 

31391 

0 80 

3 8475 

19 2375 

2 2893 

4 6170 

27 7020 

2 7476 

1 5 3865 

37 7055 

3 2055 

0 81 

3 7576 

18 7882 

2 3327 1 

4 5092 

27 0551 

2 7993 

5 2607 

36 8250 

3 2658 

0 82 

3 6634 

18 3168 

2 3713 

4 3960 

26 3761 

2 8455 

5 1287 

35 9008 

3 3198 

0 83 

3 5644 

17 8218 

2 4049 

4 2772 

25 6631 

2 8858 

4 9901 

34 9306 

3 3668 

0 84 

3 4604 

17 3020 

2 4330 

41525 

24 9149 

2 9196 

4 8447 

33 9119 

3 4062 

0 85 

3 3485 

16 7425 

2 4541 i 

4 0182 

24 1092 

2 9449 

4 6879 

32 8153 

3 4358 

0 86 

3 2316 

16 1582 

2 4687 i 

3 8780 

23 2679 

2 9624 

4 5243 

31 6702 

3 4561 

0 87 

3 1075 

15 5375 

2 4751 ' 

3 7290 

22 3740 

2 9701 ! 

4 3505 

30 4535 

3 4652 

0 88 

2 9766 

14 8832 

2 4730 

3 5720 

21 4319 

2 9676 

4 1673 

29 1712 

3 4622 

0 89 

2 8364 

14 1822 

2 4600 

3 4037 

20 4222 

2 9521 

3 9710 

27 7972 

3 4441 

0 90 

2 6878 

13 4388 

2 4356 

3 2253 

19 3518 

2 9228 

3 7628 

26 3400 

3 4099 

0 91 

2 5295 

12 6475 

2 3980 

3 0354 

18 2124 

2 8776 : 

3 5413 

24 7891 

3 3572 

0 92 

2 3588 

11 7942 

2 3435 

2 8306 

16 9837 

2 8122 

3 3024 

23 1167 

3 2809 

0 93 

2 1754 

10 8770 

2 2700 

2 6105 

15 6629 

2 7240 

3 0456 

21 3189 

31780 

0 94 

1 9768 

9 8840 

2 1731 

2 3722 

14 2330 

2 6077 

2 7675 

19 3726 

3 0423 

0 95 

1-7595 

8 7975 

2 0463 

21114 

12 6684 

2 4556 

2 4633 

17 2431 

2 8648 

0 96 

1 5182 

7 5910 

1 8795 

1 8218 

10 9310 

2 2554 

2 1255 

14 8784 

2 6313 

0 97 

1 2339 

61695 

1 6411 , 

14807 

8 8841 

1 9693 

1 7275 

12 0922 

2 2975 

0 98 

0 9406 

4 7030 

I 3658 

1 1287 

6 7723 

1 6389 

1 3168 

9 2179 

19121 

0 99 

0 5634 

2 7172 

0 9269 

1 0 6761 

3 9568 

1 1123 

0 7888 

5 4218 

1 2976 


Note, 1924 A fourth error discussed by H. H Long has been corrected, y Amer^ Jowrn 
Psychol 1922, xxxm p 303. 
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3. Table of Miiller-JJ Than Weights'^, 


p 

W 

P 

W 

P 

W 

0 50 

1000 

0 67 

0 932 

0 84 

0 694 

0 51 

1000 

0 68 

0 923 

0 85 

0 670 

0 52 

0 999 

0 69 

0 914 

0 86 

0 646 

0 53 

0 998 

0 70 

0 904 

0 87 

0 621 

0*54 

0 996 

0 71 

0 894 

0 88 

0 593 

0*55 

0 995 

0 72 

0 883 

0 89 

0 567 

0 56 

0 992 

0 73 

0 871 

0 90 

0 538 

0 57 

0 989 

0 74 

0 859 

0 91 

0 506 

0 58 

0 985 

0 75 

0 846 

0 92 

0 472 

0 59 

0 9S1 

0 76 

' 0 832 

0 93 

0 435 

0 60 

0 977 

0 77 

0 818 

0 94 

0 396 

0 61 

0 972 

0 78 

! 0 803 

0 95 

0 353 

0 62 

0 967 

0 79 

0 787 

0 96 

0 304 

0 63 

! 0 960 

0 80 

0 770 

0 97 

0 249 

0 64 

0 954 

0 81 

0 752 

0 98 

0 187 

0 65 

0 947 

0 82 

0 733 

0 99 

0 112 

0 66 

0 940 

0 83 

0 713 

1 00 

0 000 


The weight of a ^ which is less than 0*5 is the same as the weight of 
Sbp which exceeds 0*5 by the same amount. Thus the weights of ^ == 0 25 
and of ^ === 0*75 are both alike, = 0*846. 

* The table is quoted from F M Urban, “The Method of Constant Stimuli and its 
Generalisations,” Psychological Eevtew, 1910, xvn p 253 See also “Die psychophysischen 
Massmethoden als Grundlagen empinscher Messungen,” by the same author, Archiv f d, 
ges* Psychologic, xv. and xvi. 


4. Reczpiocah of pq, where p q ~ 1. 


pOT q 

JL 

P^ 

p or q 

JL 

pq 

p or q 

i 

pq 

•50 

40 

■ 

•<67 

45 

84 

75 

•51 

40 

68 

46 

•85 

79 

•52 

40 

•69 

47 

•86 

83 

•53 

40 

•70 

48 

•87 

88 

54 

40 

•71 

49 

88 

9*4 

*55 

4-1 

72 

50 

89 

10*2 

•56 

41 

73 

51 

•90 

11 1 

57 

41 

74 

52 

91 

12 2 

•58 

41 

•75 

53 

•92 

13 6 

59 

4-1 

•76 

5-4 

•93 

15 4 

60 

42 

•77 

56 

•94 

17 7 

•61 

42 

•78 

58 

95 

210 

62 

43 

*79 

60 

96 

26 0 

•63 

43 

•80 

62 

97 

34 4 

64 

44 

•81 

6-5 

•98 

510 

•65 

44 

•82 

68 

•99 

101 

•66 

4*5 

•83 

71 

100 

00 
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5. Etch’s Checking Table for the Constant Method. 

Published from the Laboratory of Cornell University, m 
Amer Journ Psychol, 1918, sxis 120. 

An example will best explain tbe use of this Table. Consider the 
example worked on p. 73. If we form for each hne the totals of the 
five quantities 

W + yW + sW -h s^W 4- syW 

we get the results 


e 

P 

Totals 

-6 

00 

0000 

-5 

10 

13 2371 

-4 

14 

9 8835 

~3 

40 

7 1880 

-2 

65 

2 5836 

0 

•80 

1 2274 

2 

87 

5 8355 

4 

•96 

8 2559 

6 

100 

0 0000 


48 2110 

These totals however will all be found m Eich’s Table entered with 
the proper s (Rich’s x) and p, and can thus be checked. The grand total 
48*2110 ought to agree with the sum of the last row of the table (4) on 
p 73, i.e. with 

4*8026 + 0*4311 ~ 7*6406 + 43*7049 4- 6*9130. 
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Rich’s Checking Table. 


p 

» = 1 

a:=2 

a,=3 

X=4: 

x = 5 

X=:6 

x^n 

01 

- 0327 

2327 

7235 

14396 

2 2810 

3 4479 

4 8403 

02 

0179 

4973 

1 3529 

2 5847 

4 1927 

6 1770 

8 5375 

03 

0843 

7430 

1 8953 

3 5414 

5 6810 

8 3142 

11 4409 

-04 

•1590 

9978 

2 4437 

4 4969 

7 1574 

10 4251 

14 3003 

•06 

2371 

1 2355 

2 9376 

5 3436 

8 4533 

12 2668 

16 7842 

06 

3170 

1 4637 

3 4012 

6 1295 

9 6485 

13 9583 

19 0586 

07 

3973 

1 6836 

3 8400 

6 8667 

10 7635 

15 5305 

21 1676 

08 

4780 

1 8963 

4 2582 

7 5637 

11 8128 

17 0052 

23 1413 

09 

•5585 

2 1025 

4 6583 

8 2259 

12 8053 

18 3965 

24 9995 

10 

6386 

2 3015 

6 0397 

8 8530 

13 7415 

19 7048 

26 7434 

11 

7179 

2 4951 

5 4068 

9 4631 

14 6339 

20 9491 

28 3994 

12 

•7967 

2 6835 

5 7609 

10 0289 

15 4875 

22 1370 

29 9770 

13 

8745 

2 8655 

6 0994 

10 5764 

16 2964 

23 2594 

31 4653 

14 

9515 

3 0431 

6 4274 

11 1043 

17 0737 

24 3361 

32 8910 

15 

1 0275 

3 2155 

6 7428 

11 6096 

17 8158 

25 3614 

34 2463 

16 

1 1031 

3 3848 

7 0506 

12 1007 

18 5349 

26 3533 

35 5559 

17 

1 1767 

3 5472 

7 3434 

12 5654 

19 2132 

27 2864 

38 7858 

18 

1 2495 

3 7059 

7 6276 

13 0148 

19 8673 

28 1850 

37 9681 

19 

1 3215 

3 8611 

7 9038 

13 4494 

20 4981 

29 0500 

39 1049 

20 

1 3927 

4 0127 

81718 

13 8699 

21 1070 

29 8830 

40 1981 

21 

1 4627 

41600 

8 4304 

14 2737 

21 6901 

30 6791 

41 2413 

22 

i 5311 

4 3032 

8 6802 

14 6624 

22 2496 

31 4418 

42 2393 

23 

1 5991 

4 4432 

8 9231 

15 0388 

22 7901 

32 1773 

43 1999 

•24 

1 6655 

4 5792 

91575 

15 4004 

23 3079 

32 8800 

44 1169 

25 

1 7310 

4 7118 

9 3846 

15 7494 

i 

23 8063 

33 6552 

44 9965 

26 

1 7954 

4 8407 

9 6039 

16 0852 

24 2844 

34 2016 

45 8369 

27 

1 8589 

4 9665 

9 8168 

16 4097 ; 

24 7451 

34 8232 

46 6439 

28 

1 9212 

5 0891 

10 0230 

16 7228 ; 

25 1886 

35 4203 

47 4177 

29 

1 9821 

5 2078 

10 2213 

17 0226 ; 

25 6116 

35 9884 

48 1530 

30 

2 0423 

5 3239 

10 4142 

17 3130 

26 0203 

36 5362 

48 8604 

31 

2 1010 

5 4367 

10 6004 

17 5921 

26 4118 

37 0596 

49 5354 

32 

2 1590 

5 5466 

10 7807 

17 8611 ! 

26 7880 

37 5612 

50 1810 

33 

2 2153 

5 6523 

10 9526 

18 1164 

27 1435 

38 0341 

50 7880 

34 

2 2712 

5 7567 

11 1217 

18 3665 

27 4908 

38 4950 

51 3789 

•35 

2 3257 

5 8564 

11 2819 

18 6019 

27 8164 

38 9254 

51 9288 

36 

2 3788 

5 9537 

114370 

18 8287 

28 1289 

39 3374 

52 4543 

•37 

2 4313 

6 0488 

11 5878 

19 0482 

28 4300 

39 7332 

52 9579 

38 i 

2 4822 

6 1397 

11 7304 

19 2543 

28 7113 

401015 

53 4248 

*39 

2 5320 

6 2282 

11*8634 

19 4525 

28 9807 

40 4530 

53 8693 

•40 

2 5804 

6 3128 

' 119988 

19 6386 

29 2319 

40 7792 

54 2800 

-41 

2 6284 

6 3958 

12 1281 

19 8191 

29 4748 

41 0933 

54 6743 

•42 

2*6747 

6 4754 

12 2468 

19 9887 

29 7013 

41 3845 

55 0384 

•43 

2 7198 

1 6 5516 

12 3609 

20 1479 

29 9124 

41 6545 

55 3741 

•44 

2 7638 

1 6 6251 

12 4698 

20 2983 

30 1103 

41 9059 

55 6849 

45 

2 8063 

1 6 6952 

12 5727 

20 4388 

30 2936 

421368 

55 9687 

•46 

2 8478 

6 7625 

12 6700 

20 5703 

30 4634 

42 3486 

56 2310 

•47 

1 2 8878 

6-8264 

12 7610 

20 6915 

30 6180 

42 6403 

56 4586 

•48 

1 2 9263 

6-8872 

12 8461 

20 8033 

30 7587 

42 7122 

56 6638 

•49 

2 9640 

6-9454 

12-9263 

20 9069 

30 8870 

i 42 8667 

56 8459 

-50 

3 0000 

7-0000 

13-0000 

i 21-0000 

31-0000 

1 43 0000 

57 0000 
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Rich's Checking Table. 


V 

x — l 

x = 2 

x~3 

CC—4: 

x = 5 

a; = 6 

x = 7 

51 

3 0348 

7 0516 

13 0679 

21 0839 

31 0994 

43 1145 

67 1291 

52 

3 0683 

7 1000 

13 1299 

21 1581 

31 1843 

43 2088 

57 2314 

53 

3 1002 

7 1450 

13 1858 

21 2225 

31 2552 

43 2835 

57 3079 

54 

3 1306 

7 1869 

13 2358 

21 2777 

31 3122 

43 3402 

57 3644 

55 

3 1595 

7 2250 

13 2791 

21 3218 

31 3531 

43 3730 

57 3815 

56 

3 1870 

7 2599 

13 3164 

21 3565 

31 3801 

43 3873 

57 3781 

57 

3 2130 

7 2914 

13 3473 

2] 3809 

31 3920 

43 3807 

57 3469 

58 

3 2371 

7 3190 

13 3716 

21 3947 

31 3885 

43 3529 

57 2880 

59 

3 2600 

7 3432 

13 3893 

21 3981 

31 3696 

43 3039 

57 2007 

60 

3 2804 

7 3630 

13 3992 

21 3890 

81 3325 

43 2298 

57 0808 

61 

3 3000 

7 3800 

13 4042 

21 3723 

31 2845 

43 1406 

56 9409 

62 

3 3174 

7 3925 

13 4006 

21 3421 

31 2167 

43 0245 

56 7654 

63 

3 3329 

7 4012 

13 3910 

21 3020 

31 1346 

42 8886 

56 5641 

64 

3 3464 

7 4051 

13 3722 

21 2477 

31 0315 

42 7238 

56 3245 

65 

3 3581 

7 4052 

13 3469 

21 1831 

30 9138 

42 5392 

56 0688 

66 

3 3676 

7 4011 

13 3143 

21 1071 

30 7796 

42 3320 

55 7639 

67 

3 3749 

7 3915 

13 2716 

21 0150 

30 6219 

42 0921 

55 4258 

68 

3 3802 

7 3784 

13 2231 

20 9141 

SO 4516 

41 8356 

55 0660 

69 

3 3830 

7 3595 

13 1642 

20 7967 

SO 2574 

41 5460 

54 6628 

70 

3 3835 

7 3357 

13 0966 

20 6660 

30 0439 

41 2304 

54 2252 

71 

3 3813 

7 3066 

13 0195 

20 5204 

29 8090 

40 8854 

53 7494 

72 

3 3768 

7 2723 

12 9340 

20 3616 

29 5550 

40 5145 

53 2397 

73 

3 3689 

7 2317 

12 8370 

20 1849 

29 2755 

40 1086 

52 6843 

•74 

3 3586 

7 1853 

12 7301 

19 9928 

28 9736 

39 6724 

62 0891 

75 

3 3450 

7 1328 

12 6124 

19 7842 

28 6481 

39 2040 

51 4521 

76 

i 3 3283 

1 7 0732 

12-4829 

19 5570 

i 28 2959 

38 6994 

50 7675 

77 

3 3083 

7 0068 1 

12-3413 

19 3114 

27 9173 

38 1589 

50 0361 

78 

3 2839 

6 9324 

12 1858 

19 0442 

27 5078 

37 5764 

49 2503 

79 

3 2563 

6 8506 

12 0178 

IS 7581 

27 0713 

36 9573 

48 4163 

•80 

3 2243 1 

6 7603 

11 8352 

18 4491 

i 

26 6020 

36 2940 

47 5249 

•81 

3 1875 

6 6603 

11 6360 

18 1148 

26 0965 i 

35 5816 

46 5695 

82 

3 1467 

6 5515 

114218 

17 7674 

25 5585 

34 8246 

45 5563 

83 

31007 

6 4330 

11 1912 

17 3752 

24 9850 

34 0200 

44 4814 

84 

3 0495 

6 3044 

10 9434 

16 9667 

24 3741 

33 1657 

43 3415 

85 

2 9907 

6 1603 

10 6694 

16 5178 

23 7056 

32 2328 

42 0995 

86 

2 9263 

6 0055 

10 3772 

16 0415 

22 9985 

31 2483 

40 7906 

87 

2 8545 

5 8355 

10 0596 

15 5266 

22 2366 

30 1896 

39 3857 

88 

2 7751 

5 6511 

9 7177 

14 9749 

21 4227 

29 0614 

37 8906 

89 

2 6859 

5 4471 

9 3428 

14 3731 

20 5379 

27 8373 

36 2716 

90 

2 5870 

5 2243 

8 9367 

13 7242 

19 5869 

26 5246 

34 5374 

91 

2 4769 

4 9801 

8 4951 

13 0219 

13 5605 

25 1109 

32 6731 

92 

2 3528 

4 7085 

8 0078 

12 2507 

17 4370 

23 5670 

30 6405 

93 

2 2133 

4 4076 

7 4720 

11 4067 

16 2115 

21 8865 

28 4316 

•94 

2 0554 

4 0713 

6 8782 

10 4757 

14 8639 

20 0429 

26 0124 

95 

1 8743 

3 6911 

6 2118 

9 4362 

13 3645 

17 9966 

23 3324 

•96 

1 6626 

3 2532 

5 4509 

8 2559 

11 6682 

15 6877 

20 3147 

97 

1 3971 

2 7122 

4 5211 

6 8236 

9 6196 

12 9092 

16 6923 

98 

1 1107 

21363 

3 5383 

5 3163 

7 4707 

10 0012 

12 9081 

99 

•7089 

1 3451 

2 2065 

3 2934 

4 5056 

6 0433 

7 8063 
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Rich's Checking Table 


V 

X— - 7 

a:= - 6 

X— -5 

a;=-4 

a;= -3 

-2 

-1 

11 

o 

01 

5 8579 

4 3203 

3 0080 

2 0210 

1 1595 

5235 

1127 

- 0727 

02 

9 7281 

7 1974 

5 0431 

3 2649 

1 8631 

8375 

1881 

- 0851 

03 

12 5809 

9 2914 

6 4954 

4 1930 

2 3841 

1 0686 

2469 

- 0813 

04 

15 3119 

11 2923 

7 8800 

5 0749 

2 8773 

1 2868 

3036 

- 0723 

05 

17 6872 

12 9552 

9 0269 

5 8024 

3 2818 

1 4649 

3519 

- 0574 

06 

19 6082 

14 4293 

10 0411 

6 4437 

3 6368 

1 6207 

3954 

- 0392 

07 

21 4324 

15 7575 

10 9527 

7 0181 

3 9536 

1 7592 

*4351 

- 0189 

08 

23 0983 

16 9684 

11 7820 

7 5391 

4 2398 

1 8841 

4718 

0031 

09 

24 6313 

18 0809 

12 5423 

8 0155 

4 5005 

1 9973 

*6059 

0263 

10 

26 0376 

19 0998 

13 2371 

8 4496 

4 7373 

2 0999 

5376 

0505 

1 

11 

27 3456 

20 0459 

13 8811 

8 8507 

4 9550 

2 1939 

5673 

0753 

12 

28 5668 

20 9282 

14 4803 

9 2231 

5 1565 

2 2805 

5953 

1007 

13 

29 6947 

21 7416 

15 0316 

9 5646 

5 3406 

2 3595 

6215 

1265 

14 

30 7546 

22 5049 

15 5479 

9 8835 

5 5118 

2 4327 

6463 

1526 

15 

31 7421 

23 2148 

16 0270 

10 1786 

5 6696 

2 4999 

6697 

1789 

16 

32 6789 

23 8875 

16 4801 

10 4569 

5 8178 

2 5628 

6921 

2055 

17 

33 5392 

24 5036 

16 8942 

10 7102 

5 9520 

2 6196 

7129 

2319 

18 

34 3503 

25 0840 

17 2831 

10 9474 

6 0772 

2 6723 

7327 

2584 

19 

35 1151 

25 6302 

17 6483 

11 1696 

6 1938 

2 7211 

7515 

2850 

20 

35 8361 

26 1442 

17 9912 

11 3773 

6 3024 

2 7665 

•7695 

3116 

21 

86 5089 

26 6229 

18 3097 

]1 5695 

6 4022 

2 8080 

7865 

3381 

22 

37 1383 

27 0696 

18 6060 

11 7474 

6 4942 

2 8458 

8025 

3643 

23 

37 7315 

27 4899 

18 8841 

11 9140 

6 5795 

2 8808 

8179 

3906 

24 

38 2837 

27 8802 

19 1433 

12 0670 

6 6575 

2 9126 

8323 

4166 

25 

38*8005 

28 2446 

19 3807 

12 2088 

6 7292 

2 9416 

8460 

4425 

•26 

39 2815 

1 28 5828 

19 6020 

12 3392 

6 7945 

2 9677 

8590 

4682 

27 

39 7311 

' 28 8980 

19 8075 

12 4595 

6 8542 

2 9915 

8713 

4938 

28 

40 1505 

29 1911 

19 9976 

12 6702 

6*9084 

3 0127 

8830 

5191 

29 

40 5354 

29 4592 

20 1706 

12 6698 

6 9567 

3 0314 

8939 

5441 

30 

40 8950 

29 7086 

20 3307 

12 7614 

7 0004 

3 0481 

9043 

5690 

31 

41 2256 

29 9368 

20 4762 

12 8435 

7 0390 

3 0625 

9140 

5935 

32 

41 5304 

30 1464 

20 6088 

12 9177 

7 0731 

3 0760 

9232 

6179 

'33 

41-8022 

30 3319 

20 7251 

12 9816 

7 1016 

3 0849 

9317 

6418 

34 

42 0577 

30 5056 

20 8330 

13 0401 

7 1269 

3 0935 

9398 

6657 

35 

42-2810 1 

30 6558 

20 9250 

13 0889 1 

7 1471 

3 1000 

9473 

6892 

36 

42 4819 

30 7896 

21 0057 

131303 

7 1632 

3*1045 

•9642 

7123 

37 

42 6633 

30 9092 

21 0766 

131654 

7 1758 

31076 

•9607 

7353 

38 

42 8156 

31 0079 

21 1333 

13 1919 

7 1836 

31085 

9666 

7578 

39 

42 9487 

31 0924 

21 1803 

13 2121 

7 1880 

3 1080 

9720 

7800 

40 

43 0548 

31 1576 

21 2141 

13 2242 

7 1880 

31056 

9768 

8018 

41 

43 1459 

31 2117 

21 2402 

13 2315 

7 1853 

3 1020 

9814 

8235 

-42 

43 2124 

31 2479 

21 2541 

13 2309 

7 1784 

3-0966 

9853 

8447 

43 

43 2573 

31 2687 

21 2576 

13 2241 

7 1681 

3 0896 

9888 

8655 

44 

43 2815 

31 2743 

21 2507 

13 2107 

7 1542 

3 0811 

9918 

8860 

45 

43 2847 

31 2648 

21 2335 

13*1908 

71367 

3 0712 

•9943 

9060 

•46 

43*2736 

31 2422 

21 2070 

13 1653 

7*1162 

3 0599 

•9964 

9257 

.47 

43 2305 

31 2019 

21 1694 

13 1327 

7 0920 

3 0470 

•9980 

9449 

•48 

43 1732 

31 1488 

21 1225 

13 0945 

7 0645 

3 0326 

9991 

9636 

•49 

43 0967 

31 0817 

21 0662 

13 0503 

7 0339 

3 0170 

9998 

9821 

-50 

43 0000 

31 0000 

21 0000 

13 0000 

7*0000 

3 0000 

10000 

1 0000 
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Rich's Checking Table 


p 

i> 

1 

II 

»= ~ 6 

= — 5 

x= -4 

a;= -3 

-2 

- 1 

x = 0 

51 

42 8843 

30 9047 

20 9246 

12 9441 

6 9631 

2 9816 

9998 

1 0175 

52 

42 7476 

30 7942 

20 8389 

12 8817 

6 9227 

2 9618 

9991 

10346 

53 

42 5935 

30 6711 

20 7446 

12 8141 

6 8796 

2 9408 

9980 

10511 

54 

42 4230 

30 5334 

20 6410 

12 7407 

6 8332 

2 9183 

9964 

1 0671 

55 

42 2251 

30 3818 

20 5271 

12 6610 

6 7835 

2 8946 

9943 

1 0820 

56 

42 0115 

30 2161 

20 4041 

12 5757 

6 7308 

2 8695 

9918 

1 0976 

57 

41 7777 

30 0357 

20 2712 

12 4843 

6 6749 

2 8430 

9888 

1 1121 

58 

41 5252 

29 8419 

20 1293 

12 3873 

6 6160 

2 8154 

9853 

1 1259 

59 

41 2511 

29 6327 

19 9770 

12 2841 

6 5537 

2 7862 

9814 

1 1393 

60 

40 9540 

29 4070 

19 8135 

12 1738 

6 4876 

2 7554 

9768 

1 1518 

61 

40 6451 

29 1728 

19 0445 

12 0603 

6 4202 

2 7242 

9720 

1 1640 

62 

40 3102 

28 9201 

19 4631 

11 9393 

6 3486 

2 6909 

9666 

1 1754 

63 

39 9587 

28 6554 

19 2736 

118132 

6 2742 

2 6568 

9607 

1 1861 

64 

39 5793 

28 3708 

19 0707 

11 6789 

6 1956 

2 6207 

9542 

1 1961 

65 

39 1834 

28 0744 

18 8600 

11 5401 

6 1145 

2 5836 

9473 

1 2054 

66 

38 7691 

27 7650 

18 6406 

11 3959 

6 0307 

2 5455 

9398 

1 2139 

67 

38 3240 

27 4335 

18 4063 

112426 

5 9422 

2 5053 

9317 

12216 

68 

37 8666 

27 0932 

18 1664 

11 0859 

5 8519 

2 4644 

9232 

1 2283 

69 

37 3802 

26 7324 

17 9126 

10 9209 

5 7572 

2 4217 

9140 

1 2345 

70 

36 8714 

26 3556 

17 6483 

10 7496 

5 6592 

2 3775 

9043 

1 2396 

71 

36 3382 

25 9614 

17 3724 

10 5712 

5 5577 

2 3318 

8939 

1 2437 

72 

35 7841 

25 5525 

17 0868 

10 3870 

5 4530 

2 2851 

8830 

1 2469 

73 

35 2007 

25 1226 

16 7871 

10 1943 

5 3440 

2 2363 

8713 

1 2488 

74 

34 5925 

24 6752 

16 4760 

9 9948 

5 2315 

2 1863 

8590 

1 2498 

•75 

33 9589 

24 2098 

16 1529 

9 7880 

51154 

2 1346 

8460 

1 2495 

76 

33 2959 

23 7236 

15 8161 

9 5732 

4 9049 

2 0814 

8323 

1 2480 

77 

32 6045 

23 2175 

15 4661 

9 3506 

4 8705 

2 0264 

8179 

1 2452 

•78 

31 8801 

22 6878 

15 1006 

9 1184 

4 7414 

19G94 

8025 

1 2407 

79 

31 1275 

22 1383 

14 7221 

8 8787 

1 4 6084 

19110 

7865 

1 2349 

80 

30 3409 

21 5648 

14 3278 

8 6297 

4 4706 

1 8505 

7695 

1 2274 

81 

29 5165 

20 9646 

13 9159 

8 3702 

4 3276 

1 7879 

7515 

12180 

82 

28 6593 

20 3416 

13 4891 

8 1020 i 

4 1802 

1 7239 

7327 

12070 

83 

27 7676 

19 6940 

13 0464 

7 8244 

4-0282 

1 6578 

7129 

11939 

84 

26 8397 

19 0215 

12 5873 

7 5373 

3 8714 

1 5896 

6921 

1 1787 

85 

25 8521 

18 3066 

12 1004 

7 2336 

3 7062 

15183 

6697 

1 1605 

86 

24 8298 

17 5675 

11 5979 

6 9211 

3 5368 

1 4451 

6463 

1 1400 

87 

23 7543 

16 7914 

11 0714 

6 5944 

3 3604 

1 3695 

6215 

1 1165 

88 

22 6316 

15 9822 

10 5235 

6 2555 

3 1781 

1 2913 

5953 

10899 

89 

21 4414 

15 1257 

9 9451 

5 8987 

2 9870 

1 2039 

5673 

10593 

90 

20 1920 

14 2284 

9*3401 

5 5268 

2 7887 

1 1255 

5376 

1 0247 

91 

18 8761 

13 2849 

8 7055 

5 1379 

2 5821 

1 0381 

5059 

9855 

92 

17 4739 

12 2814 

8 0324 

4 7269 

2 3650 

9467 

4718 

9405 

93 

15 9844 

11 2175 

7 3207 

4 2941 

21376 

8512 

4351 

8891 

94 

14 3928 

10 0831 

6 5641 

3 8359 

18982 

7515 

3954 

8300 

•95 

12 6762 

8 8626 

5 7529 

3 3470 

16448 

6465 

3519 

7612 

•96 

10 8011 

7 5333 

4 8728 

2 8195 

1 3737 

5350 

3036 

6795 

97 

8 6423 

6 0092 

3 8696 

2 2236 

10711 

4122 

*2469 

•5751 

98 

6 4503 

4 4660 

2 8579 

1-6261 

7705 

2913 

1881 

•4613 

99 

3 6335 

2 4665 

15250 

•9088 

•4181 

•1527 

1127 

2981 
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A LIST OF DEFINITE INTEGEALS OF FEEQDENT 
OCOUREENCE IN PROBABILITY WORK 


f>>x r<X) 

= ze-^‘dz=i, —zero. 
Jo J -00 




= x/tt. 




I == zero. 

0 J -CO 

^ 2«e -®“ dz = ^ ^ 

1.2 4.6...(w-l), ,,, 

°" 2.2.2 ' :2 :.2 — 


^Pcos^e + Qsm^e WiPQ)’ 


ViPQV 


^ P cos^ 0 — 2i2 cos 6 sm 0 + Q sm^ 6 \^{PQ ~ Pr) ’ 


but 1 IS not ; 


-(P^2i22r+Qz2) 7 aAt -f , r . jff 

e — Q , but is not 

=0 V V ^0 ^ 


- (Pic2+ 2 Px2/+Q2/^) 


dxdy^ 


V{PQ-Rr 

if PQ > jK^, but f [ is not 
Jo Jo ^ 


^•"(P+2i?0+Q3a) jBV'TT u 4 . • * 

e zdz — e Q , but j is 

> ’ Jo 


to] { 5 ^ 
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i = 


M = 


N = 

0 = 


yoo 

J —00 j “ 




but 

-(P-^2ife,+Qs=)^2^^ = 


2 {PQ - R^)-^ 

00 /'OO 

IS T • 

0 4 

Vff(Q + 2P^)^-fO^^ 

r 6 Q # 


if PQ>i^^ 


/:/, 


/: 

r r = ,,ifP§>P' 

J -«!-«> 2CPO-P2P 


-CO J —00 
/*C0 /'CO 


2 (pg - 
ttR 




Note In the above integrals P and Q do not^ as often, represent 
constants whose sum is unity R is a correlation coefficient, although 
it IS closely connected therewith 



INDEX 


Acinevement Quotient, 149 
Aikens, 153 
Aitken, 232, 233 
Alexander, 241 
Alienation, 152 
Anient, 6 
Anaiograph, 119 

Analysis into two normal curves, 91 
Anderson, 150 
AngeU, 6, 52 

Arithmetical short-cuts, 18, 87 
99 

Attenuation, 156, 201 

Average error, Method of, 46, 56, 77 

Average hmen, 61 

Bartlett, 203, 229, 233 
Best fitting. Meaning of, 39 
Bifactor method, 237 
Binet, 124 
Bmet Tests, 56 

Bmomial expansion, 28, 33, Standard de- 
viation of, 32 

Bisection of lines, Expenment on, 15, 
Calculations on data j&om, 21, 42, 78 
Blakeman, J , 113, 126 
Blakeman, T , 114 
Boring, 92 

Bravais, 101, 109, 119, 120, 169 
Brown, 114, 133, 146, 160, 170, 201, 202, 226 
Bruns, 61 

Burt, 124, 167, 235, 238, 241 
Carey, 172 

“Catch” errors, 54, 93 
Cave (F E. and also B M ), 150 
Central Intellective Factor {g), evidence 
for existence of, Ch. xn 
Centre of gravity same as mean, 17 
Chapman, 144 
Charlier, 86 

“Cocked hat” diagram, 14 
Colligation, 124 
Communaiities, 236 

Complete descents and ascents, Method of, 
48 

Constant Method and Process, 46, 52, 
57-75, 77, 90 
Contmgency, 125 
“Contraste sensible,” 2 
Correlated errors, 162 

Correlation, 11, 97 (Ch v, Introductory), 
107 (Ch VI, methods, see chapter 
headmg), 134 (Ch vn, partial correla- 
tion, see chapter heading), 153 (Ch, vnr, 
correction of raw correlation), 169, 201 
(Inter-columnar) 


Correlation of gains with mitial values, 163 
Crelle’s Calculatmg Tables, 44, 70, 89 
Criterion for hierarchical order, The Hart 
and Spearman, 169, 179 
Criterion Pearson’s, to determine Type 
of curve, 86 
Crum, 133 

Darwin, F , 8 
Dean, 167 
Delboeuf, 2 

Dice throws, 13, 25, 138 (three vanables), 
174-9 (hierarchies) 

Difference hypothesis, 6 
“Difference” method, 215 
Difference thresholds, 75 
Dirac, 239 

Distribution curve, 37 
Doodson, 86 

Ebbmghaus, 2, 5, 6, 7, 10 
Edgeworth, 120 
Elderton, E M., 125 
Elderton, W P , 79, 82, 87, 89 
Equal appearmg mtervals, 1, 46 
Everitt, 124 
Expectation, 17 

Factorial Analysis of Abfiity, Ch sv 
Fechner, 1, 3, 4, 6, 7, 9, 49, 61, 64, 67, 69, 
70 

Femberger, 92 
Fiion, 179, 184, 192 
Fisher, 137 

Fittmg a normal curve to data, 39 
Fitting, H , 8 

“Foot-rule,” Spearman’s, 130 
Fortes, 227 
Fourfold Table, 123 
Frobes, 6 

Galton, 59, 66, 93, 119, 149 
Garnett, 172-3, 196, 226, 227 
General Factor m Ability, 106, 138 et seq , 
142 (condition for g m three vanables), 
Ch. jx, Ch. X 
Geotropism, 8 
Gibson, 113, 114 

Goodness of Fit, Pearson’s test for, 77, 79 
Grading magmtudes and their differences, 
11 

Group Factors m Abihty, preface, 140 et 
seq , 171-3, Ch. x, 199 
Groups, Method of Senal, 47, 55, Method 
of Non-consecutave, 47, 56, 95 

Harman, 238, 241 
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Hart, 165, 168, 170 (Hart and Spearman 
cnterion, and correctional standard), 
1;9 (erroneous nature of criterion) 
Heron, 114 

Heterogeneity in data, 77 et sea , 148 
Hicks, G Dawes, 11 

Hierarchical order among correlation co- 
efficients, 154, Ch. rs, Ch. x, 201, 225, 
227, 232 » » » 

Histogram, 16, 77 
Hoisington, 92 

Holzinger, 133, 195, 201, 225, 227, 235, 238, 
241 

Hooker, 150 
Hotelling, 235, 236, 241 
Hypergeometrical series, 83 

Index correlation, 149 
Indirect methods of measurement, 9 
Integrals definite, List of. Appendix II 
Intelligence Quotient, 149 
Interquartile range of the pomt of sub- 
jective equality, 76 

Inversions of first and second order, 58 
Irwin, 227 

James, W , 1, 7 
Jeffries, 25 
Jones, 114 

Just perceptible distances, 3, 46 

KeUey, 92, 133, 152, 158, 235, 241 
Keynes, 45 
Kohler, 5 

Lay, 167 

Least Squares, Method of, 44, 66, 67, 99, 
108 

Ledermann, 233 

Limits, Method of, 46, 48-56, 63, 74 
Lme, 227 

Lmear interpolation, 60, 72 
Lipps, 54, 87 

McCaU, 93 
McDougall, 47, 134 
Maxfield, 56 

Mean, 15, 85-6 (relation to mode and median) 

Mean gradations, Method of, Z etseq, 46 

Mean variation, 20, 38 

Median, 14, 86 (between mean and mode) 

Mendelism, 190 

Merkel, 6 

Mill, J S , 97 

Minimal changes, Method of, 5, 46 
Minimal rank methods, 236, 237 (the 
Spearman School), 237 (the Thurstone 
School) 

Mode, 14, 86 

Moment coefficient, Definition of wth, 83 
Mortara, 150 
Moui, 204, 226, 226 

MuUer, 5, 7, 49, 58, 61, 65, 66, 67, 68, 69, 70 


Multiple correlation, 144, 146 et seq (worked 
example) 

Myers, 10, 55, 5S 

Non-consecutive Groups, Method of, 47, 56, 
95 

Normal correlation surface and its pro- 
perties, 119 
Normal curve, 10, 33 
Normal equations, 45, 68, 108, 138 

Observational errors, correction of corre- 
lation coefficients for, 156 
Ogive, 59, 80 
Otis, 129, 136 

Partial correlation, 105, 137, 138 (aU corre- 
lation partial), 155 See multiple corre- 
lation 

Partial r, p e of, 137 

Partiallmg out of specificalities, 215-16 

Pearl, 114 

Pearson, 10, 11, 25, 39, 43, 65, 67, 77-81 
(Goodness of Fit), 82-90 (System of 
curves), 91-93 (analysis into two normal 
curves), 101, 103, 106, Ch vi (correla- 
tion), Ch vn (selection), 137, 158, 169, 
179, 184, 188, 192, 203, 204, 209, 220, 
222, 225 226, 227, 232 
Piaggio, 227 
Pintner, 149 
Plateau, 6 
Poincar4, 9 

Precision, Measure of, 65 
Price, 241 

Probability of a judgment, 68, 75 
Probable error, 22, 38, 103 (of r), 103 (of p), 
105 (of a difference), 113 (of mean, a, r, 
and Tj), 114 (of F), 114 (for small 
samples), 137 (of partial correlation coef- 
ficient), 195, 201 (of tetrads) 
Product-Moment Formula, The Bravais- 
Pearson, 101, 108-9 (Yule’s proof), 110 
and 115 (worked examples), 119, 120 
(reached by Edgeworth) 

Production, Method of, 46, 56 
Pseudo-histogram, 61 ef seq , 77 et seq 
Psychophysical Methods, 46-76 (Ch. ni) 

Quartiles, 16 et seq 
Quotient hypothesis, 6 

Ranks, Method of, 10, 102, 104 (worked 
example of r by ranks), 106 (table 
of p and r), 130 (Spearman’s Foot- 
rule) 

Ratio 7), Correlation, 98, 110, 115 (worked 
example) 

Reciprocity of tests and persons, 238 
Regression, 100, 108 (Yule), 113 (criterion 
for hneanty), 117, 118 
Rehabihty coefficients, 133, 155 
Rich, 70, 197 
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INDEX 


Riecker, 58, 71-3, 93 

Right and Wrong Cases, Method of, same 
as Constant Method, v 
Russell, 11 

Samphng Theory of Ability, preface, Ch. x, 
195, 241 
Sanford, 10 

Scatter, Measures of, 19-24, 99 
Schuster, 125 
Seashore, 227 

Selection, The Influence of, Ch vn, 134 
(mild), 137 (rigorous), 231, 239 
Semi-interquartiie range, 16 et seq , 19 
Serial Groups, Methods of, 47, 55 
Sheppard, 43^, 62-3, 77-8, 84 (Sheppard’s 
corrections), 88, 116, 124, 129, 220, 224 
“Simple Structure,” 230-1, 235, 237, 238, 
240 

Skew Curve, Calculation of, 89 
Skewness of psychophysical data, 64, 77 
Small, 8 
Soper, 114, 227 
Space error, 48 

Spearman, 62-65 (mean limen), 130 et seq. 
(Root- rule), 132 (r of sums or differences), 
158, 163, 173, Ch vm (correction of raw 
correlation), Ch ix (general factor), Ch 
X (case agamst general factor), Ch xn 
(tetrad criterion), 219, 225, 227, 235, 241 
Speannan-Brown formula, 132 
Spearman-Holzmger formula, 203, 204 
Speciflc Factors m Ability, 140, Ch. ix, 
Ch X, 229 

“Speed preference,” 219 
Spurious correlation, 148 
Standard deviation, 20 et seq , 22 (about 
true value, 23 (of arithmetical mean), 
24 (of sum or difference), 37 (physical 
meaning of), 38 (and mean vaiiation), 
38 (and probable error) 

Statistical Method in Psychology, Ch xiy 
Stead, 192 
Stemach, 7 
Stephen, Leslie, 164 

Stephenson, 204, 209, 219, 226, 235, 241 
Stratton, 47, 55 
“Student,” 150 
Summation method, 19, 87 
Sums or differences, 132 (correlation of), 
24 (standard deviation of) 


“Tail” of distribution. Difficulties due to, 
52, 62, 64, 75, 90 
Tannery, 5 
Team of tests, 144 
Tetrachonc r, 124 
Tetrad criterion, 200 et seq ^ 216 
Thompson, J. R., 141-2, 144 
Thomson, G H , 9, 15, 53, 54, 55, 66, 60, 
64, 74, 79, 94-5, 121, 138, 149, 157, 158, 
163, 174, 175, 176, 178, 188, 193, 194, 
233 241 

Thorndike, 153, 163, 167-8, 170, 171, 194 

Thurstone, 230, 233, 237, 241 

Time error, 48, 70 

Titchener, 5, 10, 57, 58, 73 

Toops, 129, 144 

Trabue, 93 

Transfer of trainmg, 190 
Two Factors, Theory of, 164 et seq, 201, 
Ch. xni (test of) 
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